HDFGroup / HDFGroup/hdf5

cd_vals limit is too small and causes error with LibPresiso HDF5 filter

Open
#3,057 2 comments 0 reactions 1 assignee Assigned to @fortnern View on GitHub
Component - C Library Component - Documentation
Dominant language
C
Stars
988
Forks
355
Avg merge
4d 2h
Merged PRs (30d)
12

Description

https://github.com/HDFGroup/hdf5/blob/2384a731763a7ceb11e39d48cc0f6991d908389e/src/H5Pocpl.c#L951-L952

LibPressio is a compression library adapter that supports over 30 different compression libraries through a single interface. Because LibPressio needs to support arbitrary compressors, it encodes its settings into a binary string in msgpack format and stores these in cd_vals. This can result in long cd_vals strings of over 256 values (in the case of our user 399). If a user (or the library needs to query these as h5py does), then we hit this error message. Since there is no documented limit to the number of cd_vals, could this be removed?

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.