ClusterLabs / ClusterLabs/anvil

striker-collect-debug compress speed vs size optimization

Open
#622 6 comments 0 reactions 1 assignee Claimed by @digimer View on GitHub
priority low
Dominant language
Perl
Stars
7
Forks
6
PR merge metrics
No merged PRs in 30d

Description

we recently noticed that debug collection time in CI is extremely high. initially we thought that it was due to collecting screenshots (see #620 ) but in reality that´s not the case.

anvil.logs are in the order of GBs after only one hour run. This takes forever time to compress with bzip2 in default config.

A decent compromise for CI would be to add a new option for striker-collect-debug 'fast-compresss' that will set bzip2 -1 for the final tarball creation.

For a couple of simple benchmarks, this reduced the compress time by half, at the cost of doubling the final tarball size. Customers can than chose what they prefer based on their storage/network settings.

I have a patch ready in case we agree to go down this route.

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.