quickwit-oss / quickwit-oss/quickwit
Add Elasticsearch Style Collapse
Nobody has claimed this yet.
- Dominant language
- Rust
- Stars
- 11.7k
- Forks
- 597
- Avg merge
- 2d 22h
- Merged PRs (30d)
- 37
Description
Is your feature request related to a problem? Please describe.
I currently store documents with a version field in Quickwit. When I need to retrieve the latest version of documents in a query I have to use a bucket aggregation to get the ids and latest versions. Then query for these separately. This isn't very efficient.
Describe the solution you'd like
Ideally add Elasticsearch style collapse https://www.elastic.co/docs/reference/elasticsearch/rest-apis/collapse-search-results.
Describe alternatives you've considered
Allow pagination of aggregation although this wouldn't be as efficient as collapse. https://www.elastic.co/docs/reference/aggregations/search-aggregations-bucket-composite-aggregation
Additional context
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
No repository files, tests, or entry points are named in the issue. Start by reviewing the Elasticsearch collapse reference and locating Quickwit's search and aggregation implementations. Done means supporting Elasticsearch-style collapsed results while addressing the stated latest-version retrieval use case.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- rust
- Domain
- search
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 35/100