MetOffice / MetOffice/CDDS

CMIP7: reconsider compression options for CDDS

Open
#738 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
8
Forks
7
Avg merge
1d 15h
Merged PRs (30d)
23

Description

CMOR can write data using the zstandard rather than zlib compression algorithm (both are lossless). zstandard is quicker, but has a different range of numbers to determine the compression level.

Contributor guide

No contributing guide indexed for this repository

Research direction

The issue names CMOR and the zlib and zstandard compression algorithms but no files or tests. Start by locating CDDS's CMOR compression configuration and existing handling for these algorithms, then compare the available compression-level ranges and performance implications. Done means the supported option and level settings for CMIP7 are decided and implemented or documented.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
data, performance
Issue type
Feature
Difficulty
3/5
Estimated time
1-2 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.