Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Kbuild jobs download optimization #447

Open
nuclearcat opened this issue Sep 4, 2024 · 1 comment
Open

Kbuild jobs download optimization #447

nuclearcat opened this issue Sep 4, 2024 · 1 comment
Labels

Comments

@nuclearcat
Copy link
Member

When kbuild start process it need to download tarball artifact, which contain snapshot of kernel source code at specific tree, branch, commit.
This means same cluster building 35 kernel kinds - it will download same tarball at least 35 times.
With average size of tarball 200MB this is 7GB of data transfer (Azure $0.087 per GB = $0.609 per build). Often we have around 40-50 builds per 24h, so this is around $30 per day.
At month this is $900. This is not acceptable, if this is not optimized.
If we slash this at least 30 times, we can save $870 per month.
Potentially it is not happening yet, because we are scheduling build to cluster in same region. But if we start to schedule to different regions, or GCP/AWS we will have this problem.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

2 participants
@nuclearcat and others