How to use this with vLLM?
Open
- Dominant language
- Python
- Stars
- 9k
- Forks
- 775
- PR merge metrics
- No merged PRs in 30d
Description
Hi @fh2019ustc and @xfey and Team,
How should I deploy this model with vLLM? Is it just `vllm serve "ByteDance/Dolphin"` ?
And then how to call the server for page-level and element-level parsing?
Can you provide demo code?
Thanks.
Contributor guide
No contributing guide indexed for this repository
Research direction
No file or test is named. Review the repository's model-serving and page- and element-level parsing entry points, then verify the vLLM command and example calls; done means the repository contains demo guidance for deploying the model and calling both parsing modes.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- ai
- Issue type
- Documentation
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 25/100