deepseek-ai / deepseek-ai/DeepSeek-MoE

why <|EOT|> ?

Open
#37 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
2k
Forks
310
PR merge metrics
No merged PRs in 30d

Description

In finetune.py, <|EOT|> is added to the end of the output, but this is not a token in the tokenizer.

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.