bigscience-workshop / bigscience-workshop/training_dynamics
Implement the SentEval methods (linear and MLP; from What you can cram into a single {\$}{\&}!{\#}* vector: Probing sentence embeddings for linguistic properties)
Open
good first issue
- Dominant language
- No language data
- Stars
- 5
- Forks
- 4
- PR merge metrics
- No merged PRs in 30d
Description
it seems like the paper implementation is available here[here](https://github.com/facebookresearch/SentEval) and they have it for transformers [here](https://github.com/RussianNLP/rusenteval/) , so the actual todo is:
- [ ] add the https://github.com/RussianNLP/rusenteval as a submodule in our rep
- [ ] Implement the ability to do smth like `import senteval_probing; senteval_probing(huggingface_model_name, path_to_data)`
Contributor guide
No contributing guide indexed for this repository
Assessment
This issue has not been assessed yet.