ImportError: Failed to import AutoModelForCausalLM from xtuner.model.transformers_models in None
- Dominant language
- Python
- Stars
- 5.2k
- Forks
- 448
- Avg merge
- 3d 15h
- Merged PRs (30d)
- 26
Description
报错,这个错误,第一次没有跑通:
The argument `trust_remote_code` is to be used with Auto classes. It has no effect here and is ignored.
Traceback (most recent call last):
File "/maindata/data/shared/Security-SFT/dehao.li/env_root/deepseekv2_xtuner/xtuner/xtuner/tools/train.py", line 353, in
main()
File "/maindata/data/shared/Security-SFT/dehao.li/env_root/deepseekv2_xtuner/xtuner/xtuner/tools/train.py", line 342, in main
runner = Runner.from_cfg(cfg)
File "/home/dehao.li/.local/lib/python3.10/site-packages/mmengine/runner/runner.py", line 462, in from_cfg
runner = cls(
File "/home/dehao.li/.local/lib/python3.10/site-packages/mmengine/runner/runner.py", line 429, in __init__
self.model = self.build_model(model)
File "/home/dehao.li/.local/lib/python3.10/site-packages/mmengine/runner/runner.py", line 836, in build_model
model = MODELS.build(model)
File "/home/dehao.li/.local/lib/python3.10/site-packages/mmengine/registry/registry.py", line 570, in build
return self.build_func(cfg, *args, **kwargs, registry=self)
File "/home/dehao.li/.local/lib/python3.10/site-packages/mmengine/registry/build_functions.py", line 232, in build_model_from_cfg
return build_from_cfg(cfg, registry, default_args)
File "/home/dehao.li/.local/lib/python3.10/site-packages/mmengine/registry/build_functions.py", line 121, in build_from_cfg
obj = obj_cls(**args) # type: ignore
File "/maindata/data/shared/Security-SFT/dehao.li/env_root/deepseekv2_xtuner/xtuner/xtuner/model/sft.py", line 97, in __init__
llm = self._build_from_cfg_or_module(llm)
File "/maindata/data/shared/Security-SFT/dehao.li/env_root/deepseekv2_xtuner/xtuner/xtuner/model/sft.py", line 283, in _build_from_cfg_or_module
traverse_dict(cfg_or_mod)
File "/maindata/data/shared/Security-SFT/dehao.li/env_root/deepseekv2_xtuner/xtuner/xtuner/model/utils.py", line 35, in traverse_dict
set_obj_dtype(d)
File "/maindata/data/shared/Security-SFT/dehao.li/env_root/deepseekv2_xtuner/xtuner/xtuner/model/utils.py", line 15, in set_obj_dtype
for key, value in d.items():
File "/home/dehao.li/.local/lib/python3.10/site-packages/mmengine/config/config.py", line 239, in items
items.append((key, self.build_lazy(value)))
File "/home/dehao.li/.local/lib/python3.10/site-packages/mmengine/config/config.py", line 217, in build_lazy
value = value.build()
File "/home/dehao.li/.local/lib/python3.10/site-packages/mmengine/config/lazy.py", line 219, in build
obj = self.source.build()
File "/home/dehao.li/.local/lib/python3.10/site-packages/mmengine/config/lazy.py", line 77, in build
raise ImportError(
ImportError: Failed to import AutoModelForCausalLM from xtuner.model.transformers_models in None
Contributor guide
Research direction
Start with the traceback entry point in xtuner/tools/train.py, then inspect model construction in xtuner/model/sft.py and traversal in xtuner/model/utils.py. Check how the mmengine lazy configuration imports AutoModelForCausalLM from xtuner.model.transformers_models. Done means the reported configuration can pass Runner.from_cfg and build the model without this ImportError.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- machine-learning
- Issue type
- Bug
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 35/100