docling-project / docling-project/docling

How to integrate Docling VLM pipeline with OpenRouter API?

Open
#2,214 2 comments 0 reactions 0 assignees View on GitHub
question triage/close-stale
Dominant language
Python
Stars
66.4k
Forks
4.8k
Avg merge
3d 4h
Merged PRs (30d)
95

Description

### Question
I would like to integrate Docling’s VlmPipeline with [OpenRouter](https://openrouter.ai/), which provides an OpenAI-compatible API for many hosted models.

My current setup works when targeting a local LM Studio endpoint (though multimodal support there seems limited). Now I want to switch to OpenRouter to leverage its hosted models, but I’m unsure about the correct configuration for ApiVlmOptions.

Contributor guide

Open the contributing guide

Research direction

Start by reading the VlmPipeline and ApiVlmOptions configuration mentioned in the issue, then compare the working local LM Studio setup with OpenRouter’s OpenAI-compatible API. A useful contribution would define and document the correct configuration for hosted multimodal models, including what successful integration looks like.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
ai, api
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Active
Clarity
Needs clarification
Newbie friendliness
30/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.