InternLM / InternLM/xtuner

训练intermLM2_5_7b报错

Open
#811 1 comment 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
5.2k
Forks
448
Avg merge
3d 15h
Merged PRs (30d)
26

Description

```
pt-p1wvaor8-worker-0 logs: 07/05 15:59:30 - mmengine - WARNING - Dataset Dataset has no metainfo. ``dataset_meta`` in visualizer will be None.
pt-p1wvaor8-worker-0 logs: [rank2]: Traceback (most recent call last):
pt-p1wvaor8-worker-0 logs: [rank2]: File "/mnt/home/linjunpeng/reranker_llm/xtuner/xtuner/tools/train.py", line 360, in
pt-p1wvaor8-worker-0 logs: [rank2]: main()
pt-p1wvaor8-worker-0 logs: [rank2]: File "/mnt/home/linjunpeng/reranker_llm/xtuner/xtuner/tools/train.py", line 356, in main
pt-p1wvaor8-worker-0 logs: [rank2]: runner.train()
pt-p1wvaor8-worker-0 logs: [rank2]: File "/mnt/data/conda/envs/llmreranker/lib/python3.10/site-packages/mmengine/runner/_flexible_runner.py", line 1182, in train
pt-p1wvaor8-worker-0 logs: [rank2]: self.strategy.prepare(
pt-p1wvaor8-worker-0 logs: [rank2]: File "/mnt/data/conda/envs/llmreranker/lib/python3.10/site-packages/mmengine/_strategy/deepspeed.py", line 381, in prepare
pt-p1wvaor8-worker-0 logs: [rank2]: model = self.build_model(model)
pt-p1wvaor8-worker-0 logs: [rank2]: File "/mnt/data/conda/envs/llmreranker/lib/python3.10/site-packages/mmengine/_strategy/base.py", line 306, in build_model
pt-p1wvaor8-worker-0 logs: [rank2]: model = MODELS.build(model)
pt-p1wvaor8-worker-0 logs: [rank2]: File "/mnt/data/conda/envs/llmreranker/lib/python3.10/site-packages/mmengine/registry/registry.py", line 570, in build
pt-p1wvaor8-worker-0 logs: [rank2]: return self.build_func(cfg, *args, **kwargs, registry=self)
pt-p1wvaor8-worker-0 logs: [rank2]: File "/mnt/data/conda/envs/llmreranker/lib/python3.10/site-packages/mmengine/registry/build_functions.py", line 232, in build_model_from_cfg
pt-p1wvaor8-worker-0 logs: [rank2]: return build_from_cfg(cfg, registry, default_args)
pt-p1wvaor8-worker-0 logs: [rank2]: File "/mnt/data/conda/envs/llmreranker/lib/python3.10/site-packages/mmengine/registry/build_functions.py", line 121, in build_from_cfg
pt-p1wvaor8-worker-0 logs: [rank2]: obj = obj_cls(**args) # type: ignore
pt-p1wvaor8-worker-0 logs: [rank2]: File "/mnt/home/linjunpeng/reranker_llm/xtuner/xtuner/model/sft.py", line 84, in __init__
pt-p1wvaor8-worker-0 logs: [rank2]: llm = self._dispatch_lm_model_cfg(llm, max_position_embeddings)
pt-p1wvaor8-worker-0 logs: [rank2]: File "/mnt/home/linjunpeng/reranker_llm/xtuner/xtuner/model/sft.py", line 225, in _dispatch_lm_model_cfg
pt-p1wvaor8-worker-0 logs: [rank2]: llm_cfg = AutoConfig.from_pretrained(
pt-p1wvaor8-worker-0 logs: [rank2]: File "/mnt/data/conda/envs/llmreranker/lib/python3.10/site-packages/transformers/models/auto/configuration_auto.py", line 974, in from_pretrained
pt-p1wvaor8-worker-0 logs: [rank2]: config_class = get_class_from_dynamic_module(
pt-p1wvaor8-worker-0 logs: [rank2]: File "/mnt/data/conda/envs/llmreranker/lib/python3.10/site-packages/transformers/dynamic_module_utils.py", line 514, in get_class_from_dynamic_module
pt-p1wvaor8-worker-0 logs: [rank2]: return get_class_in_module(class_name, final_module)
pt-p1wvaor8-worker-0 logs: [rank2]: File "/mnt/data/conda/envs/llmreranker/lib/python3.10/site-packages/transformers/dynamic_module_utils.py", line 213, in get_class_in_module
pt-p1wvaor8-worker-0 logs: [rank2]: return getattr(module, class_name)
pt-p1wvaor8-worker-0 logs: [rank2]: AttributeError: module 'transformers_modules.internlm2_5-7b.configuration_internlm2' has no attribute 'InternLM2Config'

```
确认intermLM2.5为当前hf最新版本

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.