llnl / llnl/Silo

compression performance is slow for gzip

Open
#1 0 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
C
Stars
45
Forks
27
Avg merge
12h 34m
Merged PRs (30d)
4

Description

A user tried compressing using gzip and Silo took 2x longer to write the files. The files were smaller though. This could be an issue with how Silo was using HDF5 (maybe single chunking causes performance issues here)

-----------------------REDMINE MIGRATION-----------------------
This ticket was migrated from Redmine. As such, not all
information was able to be captured in the transition. Below is
a complete record of the original redmine ticket.

Ticket number: 3291
Status: New
Project: VisIt
Tracker: Bug
Priority: High
Subject: compression performance is slow for gzip
Assigned to: -
Category: -
Target version: -
Author: Mark Miller
Start: 02/19/2019
Due date:
% Done: 0%
Estimated time:
Created: 02/19/2019 01:41 pm
Updated:
Likelihood: 3 - Occasional
Severity: 2 - Minor Irritation
Found in version: 4.8
Impact:
Expected Use:
OS: All
Support Group: Any
Description:
A user tried compressing using gzip and Silo took 2x longer to write the files. The files were smaller though. This could be an issue with how Silo was using HDF5 (maybe single chunking causes performance issues here)

Comments:

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

No source file, test, or entry point is identified in the issue. Start by reproducing gzip compression in Silo and compare write time and output size, then investigate the suspected HDF5 single-chunking behavior; done means the cause of the slowdown is identified and the performance is covered by a reproducible result.

Written by the indexing model from the issue text.

Assessment

Tech stack
c
Domain
databases, performance
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
30/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.