quickwit-oss / quickwit-oss/quickwit
Consider different nodes for search and doc fetching
Nobody has claimed this yet.
- Dominant language
- Rust
- Stars
- 11.7k
- Forks
- 597
- Avg merge
- 2d 22h
- Merged PRs (30d)
- 37
Description
Currently the same nodes which are used for searching are used to retrieve documents.
This is done in order to hit caches, but the caches for searching and document fetching are mostly disjunct, so it should be possible to have a different set of nodes for document retrieval and for search in order to be able to spread the load further.
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
No files, tests, or entry points are named. Start by locating where the same nodes are selected for search and document retrieval, then trace how caching influences that choice. Done should mean search and document fetching can use distinct node sets while preserving the intended behavior.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- rust
- Domain
- distributed-systems, search
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 20/100