InternLM / InternLM/xtuner

模型无法转换怎么办?

Open
#989 1 comment 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
5.2k
Forks
448
Avg merge
3d 15h
Merged PRs (30d)
26

Description

模型无法转换怎么办?

02/03 10:46:39 - mmengine - INFO - Load PTH model from /private/xtuner/work_dirs/llava_llama3_8b_instruct_clip_vit_large_p14_336_e1_gpu8_sharegpt4v_pretrain/iter_7038.pth
02/03 10:46:39 - mmengine - INFO - Convert LLM to float16
Traceback (most recent call last):
File "/private/xtuner/xtuner/tools/model_converters/pth_to_hf.py", line 142, in
main()
File "/private/xtuner/xtuner/tools/model_converters/pth_to_hf.py", line 130, in main
model.to_hf(
File "/private/xtuner/xtuner/model/llava.py", line 343, in to_hf
self.to_xtuner_llava(cfg, save_dir, fp32, save_pretrained_kwargs)
File "/private/xtuner/xtuner/model/llava.py", line 361, in to_xtuner_llava
self.llm.half()
File "/opt/conda/envs/PyTorch-2.2.2/lib/python3.10/site-packages/transformers/modeling_utils.py", line 3115, in half
raise ValueError(
ValueError: `.half()` is not supported for quantized model. Please use the model as it is, since the model has already been casted to the correct `dtype`.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.