deepseek-ai / deepseek-ai/DeepSeek-OCR

是否可以使用vllm部署成在线推理服务?

Open
#174 5 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
23.9k
Forks
2.2k
PR merge metrics
No merged PRs in 30d

Description

我看README文档中用vllm做的线下推理,是否可以部署成在线推理服务。

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.