aditeyabaral / aditeyabaral/calbert
Add MLM as an objective to `SiamesePreTrainer`
未關閉
enhancement
help wanted
- 主要語言
- Python
- 星號
- 12
- 分支
- 3
- PR 合併指標
- 30 天內沒有已合併 PR
描述
Add Masked Language Modelling as an objective to the `SiamesePreTrainer` class. This will require changes to `CalBERT` class as well to allow a Transformer model to be passed as input for `model_path`. The MLM head can be extracted from `AutoModel` classes present on HuggingFace
貢獻指南
這個儲存庫沒有索引到貢獻指南
評估
這個 Issue 還沒有評估資料。