aditeyabaral / aditeyabaral/calbert
Add `NextSentencePrediction` as objective to `SiamesePreTrainer`
未关闭
enhancement
help wanted
- 主要语言
- Python
- 星标
- 12
- 派生
- 3
- PR 合并指标
- 30 天内没有已合并 PR
描述
Add Next Sentence Prediction as an objective to the `SiamesePreTrainer` class. This will require changes to `CalBERT` class as well to allow a Transformer model to be passed as input for model_path. The NSP head can be extracted from `AutoModel` classes present on HuggingFace
贡献指南
这个仓库没有索引到贡献指南
评估
这个 Issue 还没有评估数据。