quickwit-oss / quickwit-oss/quickwit
[Optim] Use tantivy's range query for timestamp filtering when facing an AllQuery.
Open
Nobody has claimed this yet.
enhancement
low-priority
- Dominant language
- Rust
- Stars
- 11.7k
- Forks
- 597
- Avg merge
- 2d 22h
- Merged PRs (30d)
- 37
Description
Right now we use a collcetor filter to skip documents that are out of the selected period.
This is a probably a decent approach if most of the documents pass that filter.
We could probably be faster however in the case of AllQuery.
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
The issue names no files or tests; begin by locating the timestamp collector filter and the AllQuery handling in the Rust search path. Compare the existing filtering behavior with Tantivy's range-query path, and consider the work done when AllQuery timestamp filtering uses the range query without changing the selected-period results.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- rust
- Domain
- performance, search
- Issue type
- Refactor
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Quiet
- Clarity
- Mostly clear
- Newbie friendliness
- 45/100