InternLM一代的微调配置Internlm_chat_20b_qlora_oasst1_e3微调Internlm2_chat_20b成功,但是chat时报错
Open
- Dominant language
- Python
- Stars
- 5.2k
- Forks
- 448
- Avg merge
- 3d 15h
- Merged PRs (30d)
- 26
Description
internlm2_chat_20b在xtuner chat时报错
ValueError: Target modules {'k_proj', 'up_proj', 'o_proj', 'q_proj', 'gate_proj', 'down_proj', 'v_proj'} not found in the base model. Please check the target modules and try again.
但是xtuner train时并没有报错,train微调时用的旧版Internlm_chat_20b_qlora_oasst1_e3.py对Internlm2_chat_20b进行微调,微调时并没有出现错误,能够正常微调,但推理时就报错了
Contributor guide
Assessment
This issue has not been assessed yet.