quickwit-oss / quickwit-oss/quickwit
Limit the maturity level or the size of splits to admit in the split store
Open
Nobody has claimed this yet.
enhancement
- Dominant language
- Rust
- Stars
- 11.7k
- Forks
- 597
- Avg merge
- 2d 22h
- Merged PRs (30d)
- 37
Description
Young&small splits have a bigger "bang for the buck" than larger splits.
- Larger splits are more likely to get evicted before going through a merge
- 1 byte of a splits saves 1 byte from being downloaded regardless of maturity, but larger/old splits tend to stick around in the cache longer (and hence cost more)
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start by locating the split store implementation and reading how splits are currently admitted, evicted, and merged. Define how split maturity and size should affect admission, then verify that the store consistently rejects or accepts splits according to the chosen policy.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- rust
- Domain
- backend
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 30/100