apache / apache/pinot

backup entire Zookeeper state for a table

Open
#9,329 0 comments 5 reactions 0 assignees View on GitHub
disaster_recovery
Dominant language
Java
Stars
6.1k
Forks
1.5k
Avg merge
1d 21h
Merged PRs (30d)
189

Description

if anything on Zookeeper goes wrong we can't recover the state.

- Pinot needs a way to backup entire zookeeper state (in consistent fashion) for a table so it would be able to recover it.
- Pinot should also validate a backup and only declare the backup valid if all deep store files referred exist

Contributor guide

Open the contributing guide

Research direction

No files or tests are identified. Start by locating how Pinot stores a table's state in ZooKeeper and records referenced deep-store files; then determine the existing entry points for backup and recovery. Done means a consistent table-state backup can be validated against all referenced deep-store files before being declared valid.

Written by the indexing model from the issue text.

Assessment

Tech stack
java
Domain
databases, distributed-systems
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
30/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.