apache / apache/incubator-pegasus

Dynamic reload duplication config

Open
#2,102 3 comments 0 reactions 0 assignees View on GitHub
type/enhancement
Dominant language
C++
Stars
2.1k
Forks
328
PR merge metrics
No merged PRs in 30d

Description

## Feature Request
In PR #2000 , we can ignore cluster id with paramater `dup_ignore_other_cluster_ids`.
However, I think this function can be more flexible.
There is no doubt that, cluster id is very useful in multiple clusters duplication situation, backup-cluster can use it to judge data's priority.
So we may want to dynamic relod duplication config when we doing duplication.

**Describe the feature you'd like:**
Here is a case:
At beging, we have two clusters like cluster A dup data to cluster B. (A ----> B)
And now, demand changes:
C cluster also need to dup to cluster B. (A,C -----> B)
We don't need to restart the nodes on B, and can reload the config **ABOUT DUP**.

Contributor guide

Open the contributing guide

Research direction

Start by reviewing PR #2000 and the dup_ignore_other_cluster_ids parameter to understand the existing duplication configuration. Trace how duplication configuration is loaded and applied, then define the reload behavior; done should allow adding cluster C to duplication into cluster B without restarting B's nodes.

Written by the indexing model from the issue text.

Assessment

Tech stack
cpp
Domain
databases, distributed-systems
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.