vllm-project / vllm-project/aibrix
Support vllm-omni to enrich multi-modality generations
Open
- Dominant language
- Go
- Stars
- 5.1k
- Forks
- 694
- Avg merge
- 1d 19h
- Merged PRs (30d)
- 98
Description
### 🚀 Feature Description and Motivation
vllm omni has been released in last Nov, image editing and image generation already have very standard interfaces and solid model integrations. AIBrix should integration with vllm-omni to support such cases.
- [ ] vllm-omni x AIBrix integration samples
- [ ] opportunity to leverage kvcache for vllm-omni
- [ ] aibrix-gateway potential changes for adaptation and payload compatibility
### Use Case
image/video generations.
### Proposed Solution
_No response_
Contributor guide
Assessment
This issue has not been assessed yet.