模型无法转换怎么办?
- Dominant language
- Python
- Stars
- 5.2k
- Forks
- 448
- Avg merge
- 3d 15h
- Merged PRs (30d)
- 26
Description
模型无法转换怎么办?
02/03 10:46:39 - mmengine - INFO - Load PTH model from /private/xtuner/work_dirs/llava_llama3_8b_instruct_clip_vit_large_p14_336_e1_gpu8_sharegpt4v_pretrain/iter_7038.pth
02/03 10:46:39 - mmengine - INFO - Convert LLM to float16
Traceback (most recent call last):
File "/private/xtuner/xtuner/tools/model_converters/pth_to_hf.py", line 142, in
main()
File "/private/xtuner/xtuner/tools/model_converters/pth_to_hf.py", line 130, in main
model.to_hf(
File "/private/xtuner/xtuner/model/llava.py", line 343, in to_hf
self.to_xtuner_llava(cfg, save_dir, fp32, save_pretrained_kwargs)
File "/private/xtuner/xtuner/model/llava.py", line 361, in to_xtuner_llava
self.llm.half()
File "/opt/conda/envs/PyTorch-2.2.2/lib/python3.10/site-packages/transformers/modeling_utils.py", line 3115, in half
raise ValueError(
ValueError: `.half()` is not supported for quantized model. Please use the model as it is, since the model has already been casted to the correct `dtype`.
Contributor guide
Assessment
This issue has not been assessed yet.