h2oai / h2oai/datatable

Internal compression filter option using gzip per column

Open
#1,748 5 comments 0 reactions 0 assignees View on GitHub
new feature
Dominant language
C++
Stars
1.9k
Forks
164
Avg merge
7h 31m
Merged PRs (30d)
1

Description

Compression filter option using gzip per column in (say) jay file. Leads to savings of 10X for disk storage for large data sets.

https://github.com/h2oai/h2oai/issues/6211#issuecomment-476905136

Related code:

https://github.com/h2oai/h2oai/blob/dev/h2oaicore/systemutils.py#L1331-L1384

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.