docling-project / docling-project/docling
How to integrate Docling VLM pipeline with OpenRouter API?
- Dominant language
- Python
- Stars
- 66.4k
- Forks
- 4.8k
- Avg merge
- 3d 4h
- Merged PRs (30d)
- 95
Description
### Question
I would like to integrate Docling’s VlmPipeline with [OpenRouter](https://openrouter.ai/), which provides an OpenAI-compatible API for many hosted models.
My current setup works when targeting a local LM Studio endpoint (though multimodal support there seems limited). Now I want to switch to OpenRouter to leverage its hosted models, but I’m unsure about the correct configuration for ApiVlmOptions.
Contributor guide
Research direction
Start by reading the VlmPipeline and ApiVlmOptions configuration mentioned in the issue, then compare the working local LM Studio setup with OpenRouter’s OpenAI-compatible API. A useful contribution would define and document the correct configuration for hosted multimodal models, including what successful integration looks like.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- ai, api
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Active
- Clarity
- Needs clarification
- Newbie friendliness
- 30/100