ROCm / ROCm/rocm-cli

vLLM install failure on an unsupported interpreter or glibc surfaces misleading uv advice

Open Beginner friendly
#237 0 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
Rust
Stars
40
Forks
9
Avg merge
4d 20h
Merged PRs (30d)
59

Description

rocm engines install vllm pins the ROCm build of vLLM (vllm==<version>+rocm<abi>), which is published as a single wheel — currently CPython 3.12 on glibc >= 2.34. On any other host the install correctly fails rather than falling back to the generic PyPI build. That behaviour is intended.

The problem is what the user is told. install_vllm_with_uv surfaces uv's raw resolver output, and for an unsatisfiable pin that output leads with dependency-confusion wording and suggests --index-strategy unsafe-best-match. The suggestion does not help here — the wheel genuinely does not exist for that interpreter/glibc — and if followed via UV_INDEX_STRATEGY it reintroduces exactly the unpinned PyPI fallback the pin exists to prevent.

Affected hosts include any 3.13 interpreter, and distributions whose glibc is older than 2.34 such as RHEL 8 (2.28) and SLES 15.7 (2.31), all of which rocm install driver otherwise supports.

Suggested fix: on that failure path, lead with the real cause — no ROCm vLLM wheel is published for this interpreter and glibc combination — and say explicitly that widening the index strategy is not a workaround. Leaving uv's own text below it is fine.

Raised during review of #176 and deliberately left out of scope there, as it is separable from the pin itself.

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start at the install_vllm_with_uv entry point and inspect how uv resolver failures are surfaced. Reproduce or trace the unsupported interpreter/glibc case, then confirm the message leads with the missing ROCm wheel explanation, warns that widening the index strategy is not a workaround, and retains uv's output below it.

Written by the indexing model from the issue text.

Assessment

Tech stack
python, rust
Domain
cli, tooling
Issue type
Bug
Difficulty
2/5
Estimated time
1-3 hours
Activity status
Quiet
Clarity
Mostly clear
Newbie friendliness
68/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.