cannot import name 'GPU_MEMORY_TYPE_CUDA_GRAPH' from 'sglang.srt.constants'
Open
Nobody has claimed this yet.
- Dominant language
- Python
- Stars
- 8.5k
- Forks
- 1.3k
- Avg merge
- 5h 36m
- Merged PRs (30d)
- 22
Description
I downloaded and ran the latest image, only to find that the relevant macro definitions are missing from the constants.py file (under the path sglang.srt.constants) within the image. Could you please advise on how to resolve this issue?
This is the content of the corresponding file of sglang in the image.
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start by inspecting sglang.srt.constants inside the downloaded image and reproduce the import of GPU_MEMORY_TYPE_CUDA_GRAPH. Compare the image's constants.py with the code that imports the name; done means the image and importing code agree and the import no longer fails.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- machine-learning
- Issue type
- Bug
- Difficulty
- 3/5
- Estimated time
- 1-2 days
- Activity status
- Active
- Clarity
- Mostly clear
- Newbie friendliness
- 50/100