quickwit-oss / quickwit-oss/quickwit
Downsampling traces
Nobody has claimed this yet.
- Dominant language
- Rust
- Stars
- 11.7k
- Forks
- 597
- Avg merge
- 2d 22h
- Merged PRs (30d)
- 37
Description
A user asked on Discord for a downsampling feature of traces.
The sampling of traces is generally done at the collector level. This is well explained in the OTEL documentation. Two sampling methods can be applied: Head Sampling or Tail Sampling.
Downsampling in Quickwit would mean that, after a given period of time, Quickwit will analyze splits and apply Head Sampling or Tail Sampling to reduce the index storage size.
This feature request needs more details. We should probably look first to other trace engines and evaluate the interest of such feature among Quickwit users.
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
No implementation files, tests, or entry points are named. Start by comparing other trace engines and evaluating interest among Quickwit users, then define the requirements for analyzing splits after a delay with head or tail sampling; done means the feature scope and expected storage reduction are agreed.
Written by the indexing model from the issue text.
Assessment
- Domain
- observability-sre
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100