apache / apache/pinot

Server Rack Metadata Retrieval and Persistence on Azure Environment

Open
#6,532 10 comments 0 reactions 0 assignees View on GitHub
Dominant language
Java
Stars
6.1k
Forks
1.5k
Avg merge
2d 3h
Merged PRs (30d)
195

Description

In order to move Pinot to cloud, cloud VM rack metadata awareness is needed for maintenance purpose and disaster recovery. In Azure use cases, fault domain (FD) metadata is needed in the Pinot ecosystem during update or fault events.

In this issue we will focus on retrieving and persisting FD and VM instance information of Azure VM for Pinot servers so that later on we can use this mapping to fit in existing Server Pool Based Instance Assignment or Replica-Group Instance Assignment based strategy for high data availability purpose.

Contributor guide

Open the contributing guide

Research direction

Start by tracing how Pinot servers currently discover and persist instance metadata, then inspect the existing Server Pool Based Instance Assignment and Replica-Group Instance Assignment paths. Define the Azure fault-domain and VM-instance mapping needed by those strategies, and verify that it remains available during update or fault events.

Written by the indexing model from the issue text.

Assessment

Tech stack
azure, java
Domain
cloud, distributed-systems
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.