compression performance is slow for gzip
Nobody has claimed this yet.
- Dominant language
- C
- Stars
- 45
- Forks
- 27
- Avg merge
- 12h 34m
- Merged PRs (30d)
- 4
Description
A user tried compressing using gzip and Silo took 2x longer to write the files. The files were smaller though. This could be an issue with how Silo was using HDF5 (maybe single chunking causes performance issues here)
-----------------------REDMINE MIGRATION-----------------------
This ticket was migrated from Redmine. As such, not all
information was able to be captured in the transition. Below is
a complete record of the original redmine ticket.
Ticket number: 3291
Status: New
Project: VisIt
Tracker: Bug
Priority: High
Subject: compression performance is slow for gzip
Assigned to: -
Category: -
Target version: -
Author: Mark Miller
Start: 02/19/2019
Due date:
% Done: 0%
Estimated time:
Created: 02/19/2019 01:41 pm
Updated:
Likelihood: 3 - Occasional
Severity: 2 - Minor Irritation
Found in version: 4.8
Impact:
Expected Use:
OS: All
Support Group: Any
Description:
A user tried compressing using gzip and Silo took 2x longer to write the files. The files were smaller though. This could be an issue with how Silo was using HDF5 (maybe single chunking causes performance issues here)
Comments:
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
No source file, test, or entry point is identified in the issue. Start by reproducing gzip compression in Silo and compare write time and output size, then investigate the suspected HDF5 single-chunking behavior; done means the cause of the slowdown is identified and the performance is covered by a reproducible result.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- c
- Domain
- databases, performance
- Issue type
- Bug
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 30/100