InternLM / InternLM/xtuner

ImportError: Failed to import AutoModelForCausalLM from xtuner.model.transformers_models in None

Open
#740 12 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
5.2k
Forks
448
Avg merge
3d 15h
Merged PRs (30d)
26

Description

报错,这个错误,第一次没有跑通:
The argument `trust_remote_code` is to be used with Auto classes. It has no effect here and is ignored.
Traceback (most recent call last):
File "/maindata/data/shared/Security-SFT/dehao.li/env_root/deepseekv2_xtuner/xtuner/xtuner/tools/train.py", line 353, in
main()
File "/maindata/data/shared/Security-SFT/dehao.li/env_root/deepseekv2_xtuner/xtuner/xtuner/tools/train.py", line 342, in main
runner = Runner.from_cfg(cfg)
File "/home/dehao.li/.local/lib/python3.10/site-packages/mmengine/runner/runner.py", line 462, in from_cfg
runner = cls(
File "/home/dehao.li/.local/lib/python3.10/site-packages/mmengine/runner/runner.py", line 429, in __init__
self.model = self.build_model(model)
File "/home/dehao.li/.local/lib/python3.10/site-packages/mmengine/runner/runner.py", line 836, in build_model
model = MODELS.build(model)
File "/home/dehao.li/.local/lib/python3.10/site-packages/mmengine/registry/registry.py", line 570, in build
return self.build_func(cfg, *args, **kwargs, registry=self)
File "/home/dehao.li/.local/lib/python3.10/site-packages/mmengine/registry/build_functions.py", line 232, in build_model_from_cfg
return build_from_cfg(cfg, registry, default_args)
File "/home/dehao.li/.local/lib/python3.10/site-packages/mmengine/registry/build_functions.py", line 121, in build_from_cfg
obj = obj_cls(**args) # type: ignore
File "/maindata/data/shared/Security-SFT/dehao.li/env_root/deepseekv2_xtuner/xtuner/xtuner/model/sft.py", line 97, in __init__
llm = self._build_from_cfg_or_module(llm)
File "/maindata/data/shared/Security-SFT/dehao.li/env_root/deepseekv2_xtuner/xtuner/xtuner/model/sft.py", line 283, in _build_from_cfg_or_module
traverse_dict(cfg_or_mod)
File "/maindata/data/shared/Security-SFT/dehao.li/env_root/deepseekv2_xtuner/xtuner/xtuner/model/utils.py", line 35, in traverse_dict
set_obj_dtype(d)
File "/maindata/data/shared/Security-SFT/dehao.li/env_root/deepseekv2_xtuner/xtuner/xtuner/model/utils.py", line 15, in set_obj_dtype
for key, value in d.items():
File "/home/dehao.li/.local/lib/python3.10/site-packages/mmengine/config/config.py", line 239, in items
items.append((key, self.build_lazy(value)))
File "/home/dehao.li/.local/lib/python3.10/site-packages/mmengine/config/config.py", line 217, in build_lazy
value = value.build()
File "/home/dehao.li/.local/lib/python3.10/site-packages/mmengine/config/lazy.py", line 219, in build
obj = self.source.build()
File "/home/dehao.li/.local/lib/python3.10/site-packages/mmengine/config/lazy.py", line 77, in build
raise ImportError(
ImportError: Failed to import AutoModelForCausalLM from xtuner.model.transformers_models in None

Contributor guide

Open the contributing guide

Research direction

Start with the traceback entry point in xtuner/tools/train.py, then inspect model construction in xtuner/model/sft.py and traversal in xtuner/model/utils.py. Check how the mmengine lazy configuration imports AutoModelForCausalLM from xtuner.model.transformers_models. Done means the reported configuration can pass Runner.from_cfg and build the model without this ImportError.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
machine-learning
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.