kernelci / kernelci/kernelci-project

Kbuild jobs download optimization

Open
#447 0 comments 0 reactions 0 assignees View on GitHub
techdebt
Dominant language
Python
Stars
14
Forks
32
Avg merge
1d 1h
Merged PRs (30d)
3

Description

When kbuild start process it need to download tarball artifact, which contain snapshot of kernel source code at specific tree, branch, commit.
This means same cluster building 35 kernel kinds - it will download same tarball at least 35 times.
With average size of tarball 200MB this is 7GB of data transfer (Azure $0.087 per GB = $0.609 per build). Often we have around 40-50 builds per 24h, so this is around $30 per day.
At month this is $900. This is not acceptable, if this is not optimized.
If we slash this at least 30 times, we can save $870 per month.
Potentially it is not happening yet, because we are scheduling build to cluster in same region. But if we start to schedule to different regions, or GCP/AWS we will have this problem.

Contributor guide

No contributing guide indexed for this repository

Research direction

No files, tests, or entry points are identified. Start by locating the Kbuild artifact-download path and the cluster scheduling or storage configuration; done means repeated builds reuse one tarball without redundant transfers across the stated deployment regions.

Written by the indexing model from the issue text.

Assessment

Domain
build-system, cloud, infrastructure
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
30/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.