docling-project / docling-project/docling

Support a remote OpenAI-compatible API backend for chart extraction (ChartExtractionApiOptions)

Open
#3,771 2 comments 2 reactions 0 assignees View on GitHub
enhancement
Dominant language
Python
Stars
66.4k
Forks
4.8k
Avg merge
2d 21h
Merged PRs (30d)
84

Description

### Requested feature
Allow Docling's chart extraction enrichment (`do_chart_extraction`) to run against a remote OpenAI-compatible Chat Completions endpoint (e.g. vLLM, Ollama, TGI, LM Studio) — the same way picture description already supports remote inference via `PictureDescriptionApiOptions` + `enable_remote_services=True`.

Concretely: an API-backed variant of `ChartExtractionModelOptions` (e.g. `ChartExtractionApiOptions`) exposing url, headers, params, prompt, timeout, and concurrency, so the chart→ CSV/code/summary step can be offloaded to a self-hosted VLM behind an HTTP API instead of loading ibm-granite/granite-vision-*-chart2csv locally through transformers.

Contributor guide

Open the contributing guide

Research direction

Locate ChartExtractionModelOptions and compare its chart-extraction entry point with PictureDescriptionApiOptions and enable_remote_services=True. Implement the requested ChartExtractionApiOptions fields—url, headers, params, prompt, timeout, and concurrency—and verify do_chart_extraction can use a remote OpenAI-compatible endpoint without loading the local chart model.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
ai, backend-api-design
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Quiet
Clarity
Mostly clear
Newbie friendliness
52/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.