modelscope / modelscope/ms-swift
flash attn和vllm，torch版本不兼容
Open
Nobody has claimed this yet.
question
stale
- Dominant language
- Python
- Stars
- 15.7k
- Forks
- 1.7k
- Avg merge
- 1d 16h
- Merged PRs (30d)
- 136
Description
Checklist / 检查清单
- I have searched existing issues, and this is a new question or discussion topic. / 我已经搜索过现有的 issues，确认这是一个新的问题与讨论。
Question Description / 问题描述
当我想训练qwen3.5 grpo强化学习时，要求vllm大于等于0.17.0版本，这要求torch版本为2.10.0，但是对于flash attn 2.8.3版本来说，我没有看到可以支持torch2.10.0的编译包，请问该怎么安装flash attn呢？
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start by checking the compatibility requirements for vllm 0.17.0 or newer, torch 2.10.0, and flash attn 2.8.3. The issue mentions no files or tests; done would be a verified installation path for these versions, or a clearly documented incompatibility and supported alternative.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- machine-learning
- Issue type
- Bug
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Quiet
- Clarity
- Needs clarification
- Newbie friendliness
- 32/100