[Feature]: auto-scheme shared_layers supports vllm pattern as default
Open
enhancement
- Dominant language
- Python
- Stars
- 1.6k
- Forks
- 175
- Avg merge
- 1d 18h
- Merged PRs (30d)
- 99
Description
### Feature Description
vllm fuses qkv, moe, etc. We should align with them and set it as default
### Motivation and Use Case
~
### Alternatives Considered
_No response_
### Definition of Done
_No response_
### Additional Context
_No response_
Contributor guide
Assessment
This issue has not been assessed yet.