apache / apache/lucene

ZSTD Compressor support in Lucene [LUCENE-8739]

Open
#9,784 39 comments 3 reactions 0 assignees View on GitHub
legacy-jira-label:features legacy-jira-priority:Minor module:core/codecs type:enhancement
Dominant language
Java
Stars
3.6k
Forks
1.4k
Avg merge
2d 11h
Merged PRs (30d)
88

Description

ZStandard has a great speed and compression ratio tradeoff. 

ZStandard is open source compression from Facebook.

More about ZSTD

---
Migrated from [LUCENE-8739](https://issues.apache.org/jira/browse/LUCENE-8739) by Sean Torres, 5 votes, updated Apr 19 2022
Attachments: [image-2022-01-11-02-18-11-402.png](https://apache.github.io/lucene-jira-archive/attachments/LUCENE-8739/image-2022-01-11-02-18-11-402.png), [image-2022-01-11-02-18-57-752.png](https://apache.github.io/lucene-jira-archive/attachments/LUCENE-8739/image-2022-01-11-02-18-57-752.png)
Linked issues:
- #10958

Pull requests: https://github.com/apache/lucene/pull/174, https://github.com/apache/lucene/pull/439

Contributor guide

Open the contributing guide

Research direction

Start by reviewing the migrated LUCENE-8739 description, its linked issue #10958, and the two referenced pull requests (#174 and #439), then read the linked ZStandard documentation. Determine the intended Lucene compressor integration and verify that ZSTD compression and decompression work correctly with the project’s existing compression behavior.

Written by the indexing model from the issue text.

Assessment

Tech stack
java
Domain
backend, search
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
20/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.