docling-project / docling-project/docling

Documentation of GPU setup

Open
#2,504 1 comment 0 reactions 4 assignees Claimed by @PeterStaar-IBM View on GitHub
documentation triage/close-stale
Dominant language
Python
Stars
66.4k
Forks
4.8k
Avg merge
3d 4h
Merged PRs (30d)
98

Description

We want to enhance the out-of-the-box experience for GPU users and advise for best setup. In this issue we collect a few bullets and ideas for the new docs page.

(in no binding order)
- docs for launching `vllm serve granite-docling` and how to use it in Docling. Best parameters for concurrency, etc
- best/recommended setup on Mac (usually mlx), Linux, Windows
- print warning in the CLI if a non-optimal setup is used

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.