docling-project / docling-project/docling

openwebui docling

Open
#2,886 1 comment 0 reactions 0 assignees View on GitHub
question triage/close-stale
Dominant language
Python
Stars
66.4k
Forks
4.8k
Avg merge
2d 21h
Merged PRs (30d)
84

Description

The content extraction engine I set in the documentation feature of OpenWebUI is docling. However, when handling files containing images, docling's powerful OCR recognition can indeed parse the images, but they are saved in base64 encoding. Moreover, this content is given to the large language model for processing with an "image" placeholder, which means that in reality, my model does not know what the images contain. What should I do?
The OpenWebUI settings are as follows:

Image

The file with images is parsed as follows, and you can see that the image is an 'image'.

Image

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.