deepseek-ai / deepseek-ai/DeepSeek-Math
My environment is something wrong with flash-atten, can I drop it when finetune DeepSeek-Math?
Open
- Dominant language
- Python
- Stars
- 3.4k
- Forks
- 592
- PR merge metrics
- No merged PRs in 30d
Description
Hello, there is something wrong with flash-attn, can I drop it when I finetune DeepSeek-Math? Will it destroy the performance of the model? Thank you.
Contributor guide
No contributing guide indexed for this repository
Assessment
This issue has not been assessed yet.