InternLM / InternLM/xtuner

InternLM一代的微调配置Internlm_chat_20b_qlora_oasst1_e3微调Internlm2_chat_20b成功,但是chat时报错

Open
#518 4 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
5.2k
Forks
448
Avg merge
3d 15h
Merged PRs (30d)
26

Description

internlm2_chat_20b在xtuner chat时报错
ValueError: Target modules {'k_proj', 'up_proj', 'o_proj', 'q_proj', 'gate_proj', 'down_proj', 'v_proj'} not found in the base model. Please check the target modules and try again.
但是xtuner train时并没有报错,train微调时用的旧版Internlm_chat_20b_qlora_oasst1_e3.py对Internlm2_chat_20b进行微调,微调时并没有出现错误,能够正常微调,但推理时就报错了

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.