bigscience-workshop / bigscience-workshop/training_dynamics

Implement the SentEval methods (linear and MLP; from What you can cram into a single {\$}{\&}!{\#}* vector: Probing sentence embeddings for linguistic properties)

Open
#6 0 comments 0 reactions 0 assignees View on GitHub
good first issue
Dominant language
No language data
Stars
5
Forks
4
PR merge metrics
No merged PRs in 30d

Description

it seems like the paper implementation is available here[here](https://github.com/facebookresearch/SentEval) and they have it for transformers [here](https://github.com/RussianNLP/rusenteval/) , so the actual todo is:

- [ ] add the https://github.com/RussianNLP/rusenteval as a submodule in our rep
- [ ] Implement the ability to do smth like `import senteval_probing; senteval_probing(huggingface_model_name, path_to_data)`

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.