apache / apache/lucene

Should we increase `BufferedChecksum`'s buffer from 1 KB -> 2 KB?

Open
#15,572 8 comments 0 reactions 0 assignees View on GitHub
type:enhancement
Dominant language
Java
Stars
3.6k
Forks
1.4k
Avg merge
2d 11h
Merged PRs (30d)
88

Description

Spinoff from [this comment](https://github.com/apache/lucene/issues/15552#issuecomment-3720969176) from @rmuir. Modern SIMD registers have gotten wider, and maybe that means it's worth using a larger `byte[]` when computing Lucene's CRC32 checkums?

Contributor guide

Open the contributing guide

Research direction

Start by locating BufferedChecksum and reviewing how its byte[] buffer is used when computing Lucene CRC32 checksums. Benchmark the 1 KB and 2 KB alternatives under representative workloads, then document the measured trade-off and update the buffer only if the results support the change.

Written by the indexing model from the issue text.

Assessment

Tech stack
java
Domain
performance, search
Issue type
Refactor
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.