vllm-project / vllm-project/aibrix

Support vllm-omni to enrich multi-modality generations

Open
#1,865 3 comments 0 reactions 1 assignee Claimed by @varungup90 View on GitHub
Dominant language
Go
Stars
5.1k
Forks
694
Avg merge
1d 19h
Merged PRs (30d)
98

Description

### 🚀 Feature Description and Motivation

vllm omni has been released in last Nov, image editing and image generation already have very standard interfaces and solid model integrations. AIBrix should integration with vllm-omni to support such cases.

- [ ] vllm-omni x AIBrix integration samples
- [ ] opportunity to leverage kvcache for vllm-omni
- [ ] aibrix-gateway potential changes for adaptation and payload compatibility

### Use Case

image/video generations.

### Proposed Solution

_No response_

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.