Is MOSS-VL-Realtime-NF4 supported by SGLang?
Nobody has claimed this yet.
- Dominant language
- HTML
- Stars
- 708
- Forks
- 32
- Avg merge
- 1d 18h
- Merged PRs (30d)
- 5
Description
Hello,
I would like to ask whether MOSS-VL-Realtime-NF4 is currently supported by SGLang.
We are planning to deploy MOSS-VL-Realtime-NF4 for inference and would like to use SGLang as the inference backend.
Could you please clarify:
Is MOSS-VL-Realtime-NF4 compatible with SGLang?
If so, is there any recommended configuration, branch, or specific SGLang version that we should use?
If it is not currently supported, are there any plans to add SGLang support in the future?
Thank you for your help!
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start by checking SGLang's documented support for MOSS-VL-Realtime-NF4 and the model's deployment requirements. Confirm whether a supported configuration, branch, or version exists; if not, determine whether support would need to be added and whether maintainers have stated plans.
Written by the indexing model from the issue text.
Assessment
- Domain
- ai, backend
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Active
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100