[Bug]: LoRA微调时报错：--deepspeed: invalid dict value
Open
Nobody has claimed this yet.
bug
triage
- Dominant language
- Jupyter Notebook
- Stars
- 11.1k
- Forks
- 763
- Avg merge
- 6h 3m
- Merged PRs (30d)
- 5
Description
Is there an existing issue ? / 是否已有相关的 issue ?
- I have searched, and there is no existing issue. / 我已经搜索过了，没有相关的 issue。
Describe the bug / 描述这个 bug
我运行LoRA微调命令：bash ./lora_finetune_ocnli.sh，报错：
finetune.py: error: argument --deepspeed: invalid dict value: 'configs/ds_config_zero3_offload.json'
To Reproduce / 如何复现
复现步骤：
cd MiniCPM/finetune
conda activate cpm # cpm是我为MiniCPM创建的虚拟环境
# 我已经运行此目录下pip install -r requirements.txt
bash ./lora_finetune_ocnli.sh
报如下错误：
finetune.py: error: argument --deepspeed: invalid dict value: 'configs/ds_config_zero3_offload.json'
注：我看了funetune.py文件，里面没有定义--deepspeed命令行参数。
Expected behavior / 期望的结果
可以正确启动LoRA微调过程
Screenshots / 截图
Environment / 环境
- OS: [Ubuntu 22.04]
- Pytorch: [torch 2.7.1-cu126]
- CUDA: [CUDA 12.4]
- Device: [ A100 40G 4块]
Additional context / 其他信息
No response
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start by reading finetune/lora_finetune_ocnli.sh and finetune.py, then inspect the referenced configs/ds_config_zero3_offload.json path and how --deepspeed is parsed. Re-run the documented command from the finetune directory and confirm that the LoRA fine-tuning process starts without the invalid dict value error.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- bash, python, pytorch
- Domain
- machine-learning
- Issue type
- Bug
- Difficulty
- 3/5
- Estimated time
- 1-2 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 35/100