deepseek-ai / deepseek-ai/DeepSeek-MoE
why <|EOT|> ?
Open
- Dominant language
- Python
- Stars
- 2k
- Forks
- 310
- PR merge metrics
- No merged PRs in 30d
Description
In finetune.py, <|EOT|> is added to the end of the output, but this is not a token in the tokenizer.
Contributor guide
No contributing guide indexed for this repository
Assessment
This issue has not been assessed yet.