docling-project / docling-project/docling-jobkit
Kubeflow run fails when downloading models with "too many requests"
Open
bug
- Dominant language
- Python
- Stars
- 36
- Forks
- 47
- Avg merge
- 4d 22h
- Merged PRs (30d)
- 15
Description
With a high number of documents and low batch size resulting into a potential high number of parallel pods, models are downloaded concurrently and it creates a _too many requests_ error, which results in failures.
As pointed out by @SantanaTiago
> Regardless if batch size fix this issue or not, I think some kind of retry mechanism to get models (init Docling converter) should be implemented
Contributor guide
Assessment
This issue has not been assessed yet.