apache / apache/pinot

Auto-recovery when segment is collapsed on server

Open
#6,080 0 comments 0 reactions 1 assignee Claimed by @Jackie-Jiang View on GitHub
Dominant language
Java
Stars
6.1k
Forks
1.5k
Avg merge
1d 21h
Merged PRs (30d)
189

Description

Segment could collapse during the pre-process on server side, e.g. server shut down in the middle of the segment preprocessing. In such scenario, the next time when trying to load the segment, the server should drop the collapsed segment and download a new copy from the controller/deep storage.
We need to handle this logic in:
- Segment loading when server starts
- Refreshing segment
- Reloading segment

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.