huggingface / huggingface/setfit

[FR] add Dropout to Dense SetFitHead

Open
#151 2 comments 0 reactions 0 assignees View on GitHub
enhancement
Dominant language
Jupyter Notebook
Stars
2.8k
Forks
267
Avg merge
36m
Merged PRs (30d)
5

Description

Hi,
maybe a dropout layer in the Dense SetFitHead would be nice to have.
Implementation could be like in the Transformers `BertForSequenceClassification` head:

https://github.com/huggingface/transformers/blob/d447c460b16626c656e4d7a9425f648fe69517b3/src/transformers/models/bert/modeling_bert.py#L1506-L1517

What do you think? @blakechi @lewtun

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.