huggingface / huggingface/alignment-handbook
Dependency updates for QLoRA+FSDP
Open
- Dominant language
- Python
- Stars
- 5.7k
- Forks
- 490
- Avg merge
- 2m
- Merged PRs (30d)
- 1
Description
For QLoRA+FSDP support, the dependencies should be updated:
- `bitsandbytes>=0.43.0`
- `accelerate>=0.28.0`
- `transformers>4.38.2`
- `trl>0.7.11`
- `peft>0.9.0`
Also, it would be wonderful to have accelerate recipe for this too.
Contributor guide
No contributing guide indexed for this repository
Assessment
This issue has not been assessed yet.