dask / dask/partd

Add zstd as a compression option?

Open
#30 5 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
107
Forks
32
PR merge metrics
No merged PRs in 30d

Description

would there be interest in adding zstd to partd. At lowish compression levels I've found it to have better compression and around twice as fast as snappy.

Contributor guide

Open the contributing guide

Research direction

The issue names no files or tests. Start by tracing partd's existing compression options and Snappy integration, then identify how dependencies and selectable options are defined. Done means zstd can be selected and works alongside the existing compression choices.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
database
Issue type
Feature
Difficulty
3/5
Estimated time
1-2 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.