InternLM / InternLM/xtuner

weight is on the meta device, we need a `value` to put it in 0 when convert Qwen2-0.5B

Open
#786 3 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
5.2k
Forks
448
Avg merge
3d 15h
Merged PRs (30d)
26

Description

I have successfully SFTed Qwen2-0.5B using XTuner. When I convert the qlora checkpoint to hf, `weight is on the meta device, we need a `value` to put it in 0` occurs.

convert command
```
CUDA_VISIBLE_DEVICES=0 xtuner convert pth_to_hf qwen2_config qwen2_checkpoint qwen2_res
```

### Environment
- GPU: V100
- XTuner: 0.1.21
- CUDA: 11.8

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.