vllm-project / vllm-project/aibrix

Support DeepSeek/DeepSeek-OCR

Open
#1,697 5 comments 0 reactions 1 assignee Claimed by @Jeffwan View on GitHub
area/gateway area/multimodality
Dominant language
Go
Stars
5.1k
Forks
694
Avg merge
1d 19h
Merged PRs (30d)
98

Description

### 🚀 Feature Description and Motivation

https://docs.vllm.ai/projects/recipes/en/latest/DeepSeek/DeepSeek-OCR.html#running-deepseek-ocr

1. this file doesn't have api interface, user need to leverage LLM class
2. it doesn't have batch api support.

### Use Case

Support ocr images

### Proposed Solution

_No response_

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.