InternLM / InternLM/xtuner

Convert .pth of lava-phi3-lora failed

Open
#745 3 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
5.2k
Forks
448
Avg merge
3d 15h
Merged PRs (30d)
26

Description

I finetuned llava-phi3 model with lora, but when I try to convert the resulting weight, an error occurred.

This I my command:
xtuner convert pth_to_hf ./my_configs/llava_phi3_mini_qlora_clip_vit_large_p14_336_lora_e1_gpu8_finetune_copy.py /mnt/xushixiong/outputs/xtuner/work_dirs/llava_phi3_mini_qlora_clip_vit_large_p14_336_lora_e1_gpu8_finetune_copy/iter_17920.pth/mp_rank_00_model_states.pt ./outputs/sf_0604_xtuner

![image](https://github.com/InternLM/xtuner/assets/59325025/38934782-9aa4-4059-b9c8-7204132a4a78)
The error looks like this, it seems that the convert of llava-phi3-lora is not supported? what can I do?

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.