apache / apache/pinot

Messures and Doc for index freshness/update

Open
#14,371 3 comments 0 reactions 1 assignee Claimed by @R-tooR View on GitHub
documentation good first issue
Dominant language
Java
Stars
6.1k
Forks
1.5k
Avg merge
2d 55m
Merged PRs (30d)
182

Description

A part of Pinots secret sauce for speed are indexes.
Is there any info available what index freshness/delay is achievable for newly ingested data / just changed data (upsert) for the different kinds of indexes?
on how this could be improved/reduced?
On how index updating works for each type?

of course I found
- some info snippets in some issues in this field:
- https://github.com/apache/pinot/issues/6431
- https://github.com/apache/pinot/issues/13504
- some sentence on it in the doc for native text index
https://docs.pinot.apache.org/basics/indexing/native-text-index
- etc

but no overview / table summing this topic up.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.