Use numcodecs VLenArray for encoding variable length dataset chunks
Open
enhancement
performance
- Dominant language
- Python
- Stars
- 157
- Forks
- 60
- Avg merge
- 1d 5h
- Merged PRs (30d)
- 15
Description
Doc on VLenArray is here: https://numcodecs.readthedocs.io/en/stable/vlen.html#vlenarray.
I'm pretty sure that this will be more performant than the run length encoding that is done in hsds/util/arraydata.py currently.
Care will be needed to ensure that data written in the original schema is still readable.
Contributor guide
No contributing guide indexed for this repository
Assessment
This issue has not been assessed yet.