apache / apache/incubator-pegasus

Feature: Supports node black list for load balancing.

Open
#1,976 0 comments 0 reactions 0 assignees View on GitHub
type/enhancement
Dominant language
C++
Stars
2.1k
Forks
328
PR merge metrics
No merged PRs in 30d

Description

## Feature Request

**Describe the feature you'd like:**

When load balancing, we can set up a blacklist of nodes such that there will be no sharding in and out on those nodes.

**Teachability, Documentation, Adoption, Migration Strategy:**

During load balancing, we use replica counts as an evaluation criterion for slice migration. However, the size of each slice is uncertain. A node may have fewer slices but larger disk load. If we perform load balancing at this time, it will cause more load pressure on this type of nodes.
In addition, the machines in a cluster may be of different models and have different disk sizes.
So this feature can help us to do more flexible load balancing.

Contributor guide

Open the contributing guide

Research direction

The issue names no files, tests, or entry points; start by locating the existing load-balancing and slice-migration code and its node configuration or API. Define how a node blacklist is supplied, then add coverage showing that blacklisted nodes have no shard movement while ordinary nodes still balance.

Written by the indexing model from the issue text.

Assessment

Tech stack
cpp
Domain
databases, distributed-systems
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.