docling-project / docling-project/docling-jobkit

Kubeflow run fails when downloading models with "too many requests"

Open
#21 0 comments 0 reactions 3 assignees Claimed by @vku-ibm View on GitHub
bug
Dominant language
Python
Stars
36
Forks
47
Avg merge
4d 22h
Merged PRs (30d)
15

Description

With a high number of documents and low batch size resulting into a potential high number of parallel pods, models are downloaded concurrently and it creates a _too many requests_ error, which results in failures.

As pointed out by @SantanaTiago
> Regardless if batch size fix this issue or not, I think some kind of retry mechanism to get models (init Docling converter) should be implemented

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.