I encountered an issue while preparing the training environment for omg-llava
Nobody has claimed this yet.
- Dominant language
- Python
- Stars
- 1.4k
- Forks
- 55
- PR merge metrics
- No merged PRs in 30d
Description
I installed the conda environment according to the given process, and an error occurred when executing the fine-tuning code:
PYTHONPATH=. NPROC_PER_NODE=8 xtuner train \
omg_llava/configs/finetune/omg_llava_7b_finetune_8gpus.py \
--deepspeed deepspeed_zero2
[WARNING] ZenFlow disabled: torch internal optimizer symbols could not be imported: cannot import name '_disable_dynamo_if_unsupported' from 'torch.optim.optimizer' (/data1/ns/anaconda3/envs/omg-llava/lib/python3.10/site-packages/torch/optim/optimizer.py)
08/25 16:39:07 - mmengine - WARNING - WARNING: command error: 'name '_disable_dynamo_if_unsupported' is not defined'!
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start with the reported xtuner train command and omg_llava/configs/finetune/omg_llava_7b_finetune_8gpus.py, then inspect the installed torch version and the ZenFlow warning. Reproduce the command and identify the environment mismatch causing the missing optimizer symbol; done means fine-tuning starts without the reported NameError.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python, pytorch
- Domain
- machine-learning
- Issue type
- Bug
- Difficulty
- 3/5
- Estimated time
- 1-2 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 35/100