facebook / facebook/zstd

Is zstd splitabble in hadoop/spark/etc?

Open
#395 58 comments 13 reactions 0 assignees View on GitHub
Dominant language
C
Stars
27.9k
Forks
2.6k
Avg merge
1d 3h
Merged PRs (30d)
8

Description

I know the 4mc container adds splitability to zstd but is the standard by itself able to do so without the help of 3rd party implementations?

Note: I am aware zstd still not officially implemented in Hadoop so this is more like a theoretical question.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.