bytedance / bytedance/Dolphin

How to use this with vLLM?

Open
#22 10 comments 8 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
9k
Forks
775
PR merge metrics
No merged PRs in 30d

Description

Hi @fh2019ustc and @xfey and Team,

How should I deploy this model with vLLM? Is it just `vllm serve "ByteDance/Dolphin"` ?

And then how to call the server for page-level and element-level parsing?

Can you provide demo code?

Thanks.

Contributor guide

No contributing guide indexed for this repository

Research direction

No file or test is named. Review the repository's model-serving and page- and element-level parsing entry points, then verify the vLLM command and example calls; done means the repository contains demo guidance for deploying the model and calling both parsing modes.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
ai
Issue type
Documentation
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.