bigscience-workshop / bigscience-workshop/training_dynamics
Implement the control tasks technique to ensure probes are selective (from Designing and Interpreting Probes with Control Tasks)
Open
- Dominant language
- No language data
- Stars
- 5
- Forks
- 4
- PR merge metrics
- No merged PRs in 30d
Description
it seems like the paper implementation is available [here](https://worksheets.codalab.org/worksheets/0xb0c351d6f1ac4c51b54f1023786bf6b2) , so the actual todo is:
- [ ] add thehttps://worksheets.codalab.org/worksheets/0xb0c351d6f1ac4c51b54f1023786bf6b2 as a submodule in our rep
- [ ] Implement the ability to do smth like `import control_tasks_probing; from senteval_probing import probing; control_tasks(huggingface_model_name, path_to_data, senteval_probing)`
Contributor guide
No contributing guide indexed for this repository
Assessment
This issue has not been assessed yet.