InternLM / InternLM/xtuner

internlm2_20b_qlora_msagent_react_e3_gpu8训练时如何添加自己的词汇表呢?

Open
#805 10 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
5.2k
Forks
448
Avg merge
3d 15h
Merged PRs (30d)
26

Description

首先,感谢上海人工智能实验室及其成员对书生模型、代码框架、技术经验的分享!

请问,internlm2_20b_qlora_msagent_react_e3_gpu8训练时如何添加自己的词汇表呢?

比如:breed_name、area_name等,当做一个token。

谢谢!

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.