On-Demand download can be easily overloaded
Nobody has claimed this yet.
- Dominant language
- Python
- Stars
- 598
- Forks
- 168
- Avg merge
- 1d 4h
- Merged PRs (30d)
- 86
Description
Version
3.18
Describe the bug
During a LEAPP upgrade of a Satellite client, or during its convert2RHEL procedure, the client can easily hit timeout errors when downloading packages from Satellite.
This happens when the repositories with the packages have On Demand download policy (which is the default) and when majority of the packages are not yet downloaded. The feature is not tuned or scaled up for a bulk request of hundreds or even thousands of packages to download from Satellite.
This ends up in repeated upgrade (or convert) failures, always on timeouts of different packages download.
See the BZ for more details
To Reproduce
Simulate a heavy load of downloading files from a fresh Pulp repository configured with on-demand.
Additional context
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
No source file, test, or entry point is named. Start by reviewing the linked Bugzilla report and reproducing the heavy download load described for a fresh Pulp repository with on-demand downloads. Done should mean bulk requests no longer repeatedly fail with package-download timeouts.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- backend, performance
- Issue type
- Bug
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100