bigscience-workshop / bigscience-workshop/multilingual-modeling
[Lower Priority] Implement "Fisher Induced Sparse uncHanging (FISH) Mask"
Open
- Dominant language
- Python
- Stars
- 75
- Forks
- 17
- PR merge metrics
- No merged PRs in 30d
Description
Paper: https://arxiv.org/pdf/2111.09839.pdf
Code: https://github.com/varunnair18/FISH/blob/main/transformers/examples/text-classification/run_glue_sparse_update.py
This will be relatively easy to add to our code.
Contributor guide
No contributing guide indexed for this repository
Assessment
This issue has not been assessed yet.