[Feature]: hadamard vllm inference support
Open
enhancement
- Dominant language
- Python
- Stars
- 1.6k
- Forks
- 175
- Avg merge
- 1d 18h
- Merged PRs (30d)
- 99
Description
### Feature Description
support vllm inference for the rotation + mxfp4 quantized model
### Motivation and Use Case
support vllm inference for the rotation + mxfp4 quantized model
### Alternatives Considered
_No response_
### Definition of Done
_No response_
### Additional Context
_No response_
Contributor guide
Assessment
This issue has not been assessed yet.