facebookresearch / facebookresearch/fairseq2
Clean up and extend the LoRA API
Open
enhancement
modeling
- Dominant language
- Python
- Stars
- 1.1k
- Forks
- 144
- Avg merge
- 4d 1h
- Merged PRs (30d)
- 1
Description
The current LoRA API is not feature complete per our internal design doc. In particular, loading and saving LoRA adapters is not supported at the moment. Revise the current API with the recently-introduced helper tools (e.g. `select_parameters()`) and add the missing features mentioned in the doc.
Contributor guide
Assessment
This issue has not been assessed yet.