quickwit-oss / quickwit-oss/quickwit
Migrate embedded checkpoint in index metadata to shard table
Open
Nobody has claimed this yet.
enhancement
tech debt
- Dominant language
- Rust
- Stars
- 11.7k
- Forks
- 597
- Avg merge
- 2d 22h
- Merged PRs (30d)
- 37
Description
Ingest V2 stores the publish position directly in shards. We want all sources to use this scheme to store their checkpoints.
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
No files, tests, or entry points are named in the issue. Trace how Ingest V2 stores the publish position in shards, compare that with how other sources store checkpoints in index metadata, and verify that all sources use the shard-table scheme without losing checkpoint data.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- rust
- Domain
- backend
- Issue type
- Refactor
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 32/100