how can I use Xtuner in Cuda12.8?
Open
- Dominant language
- Python
- Stars
- 5.2k
- Forks
- 448
- Avg merge
- 3d 15h
- Merged PRs (30d)
- 26
Description
bitsandbytes has been updated to 0.45.3 for Cuda12.8, but Xtuner need bitsandbytes=0.45.0, how can I use Xtuner in Cuda12.8 which can support RTX5090? is there any update plan or some other method can help me?
xtuner 0.2.0rc0 requires bitsandbytes==0.45.0, but you have bitsandbytes 0.45.3 which is incompatible.
Contributor guide
Assessment
This issue has not been assessed yet.