facebook / facebook/zstd

Shrink literal decoding buffer for streaming compressiong

Open
#3,609 0 comments 1 reaction 0 assignees View on GitHub
Dominant language
C
Stars
27.9k
Forks
2.6k
Avg merge
1d 3h
Merged PRs (30d)
8

Description

In streaming compression, memory usage is very important. We recently added the capability to split the literals between the output buffer & the dctx. But the size of this buffer is fixed at compile time. We should either:

1. Allow this to be configurable at runtime, so that users can choose the speed vs. memory usage tradeoff.
2. Shrink the compile time constant down to be small enough to suit most use cases, like 4KB or maybe 16KB.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.