A question about eos_token_id
未關閉
- 主要語言
- Jupyter Notebook
- 星號
- 1.1k
- 分支
- 120
- PR 合併指標
- 30 天內沒有已合併 PR
描述
Hi,OLMoE Team
Thank you for your work, so that more people can join this work.
In the readme I saw that tokenizer.eos_token_id is set to 50279. But in the .yml configuration file I found that eos_token_id is 0. How should I understand this difference? Maybe it's because of the vocab_size of 50280?Thank you！
貢獻指南
這個儲存庫沒有索引到貢獻指南
評估
這個 Issue 還沒有評估資料。