modelscope / modelscope/ms-swift
多模态GRPO训练下采用Colocate 模式，在训练脚本中的deepspeed_zero是不是只能用zero3？
Open
Nobody has claimed this yet.
question
- Dominant language
- Python
- Stars
- 15.7k
- Forks
- 1.7k
- Avg merge
- 1d 16h
- Merged PRs (30d)
- 136
Description
Checklist / 检查清单
- I have searched existing issues, and this is a new question or discussion topic. / 我已经搜索过现有的 issues，确认这是一个新的问题与讨论。
Question Description / 问题描述
多模态GRPO训练下采用Colocate 模式，在训练脚本中的deepspeed_zero是不是只能用zero3？
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start by tracing the multimodal GRPO training path and the Colocate-mode handling of the training script's deepspeed_zero setting. Check how supported ZeRO levels are validated or used, then document whether only zero3 is supported and identify the relevant configuration or limitation.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- distributed-systems, machine-learning
- Issue type
- Documentation
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Quiet
- Clarity
- Needs clarification
- Newbie friendliness
- 35/100