Pinot S3 Deep Storage - High Availability for Controllers
Open
- Dominant language
- Java
- Stars
- 6.1k
- Forks
- 1.5k
- Avg merge
- 2d 55m
- Merged PRs (30d)
- 182
Description
If i configured S3 to be used for Deep Storage and have a 3 node Zookeeper Cluster, if i want to also have the Controller in High Availability, is that enough, or do I require to use EFS or an HDFS cluster. Wondering in how an actual Production Environment would look like on AWS
Contributor guide
Research direction
Start by reviewing Pinot's S3 deep-storage, controller high-availability, and ZooKeeper deployment guidance, then compare the EFS and HDFS alternatives for AWS production. Done means the issue has a clear, documented production architecture and states whether S3 plus the listed ZooKeeper and controller setup is sufficient.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- aws, java
- Domain
- cloud, distributed-systems
- Issue type
- Documentation
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 30/100