backup entire Zookeeper state for a table
Open
disaster_recovery
- Dominant language
- Java
- Stars
- 6.1k
- Forks
- 1.5k
- Avg merge
- 1d 21h
- Merged PRs (30d)
- 189
Description
if anything on Zookeeper goes wrong we can't recover the state.
- Pinot needs a way to backup entire zookeeper state (in consistent fashion) for a table so it would be able to recover it.
- Pinot should also validate a backup and only declare the backup valid if all deep store files referred exist
Contributor guide
Research direction
No files or tests are identified. Start by locating how Pinot stores a table's state in ZooKeeper and records referenced deep-store files; then determine the existing entry points for backup and recovery. Done means a consistent table-state backup can be validated against all referenced deep-store files before being declared valid.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- java
- Domain
- databases, distributed-systems
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 30/100