apple / apple/foundationdb

Exclude should prefer to move write hot shards first

Open
#2,861 0 comments 1 reaction 0 assignees View on GitHub
Dominant language
C++
Stars
16.7k
Forks
1.6k
Avg merge
1d 20h
Merged PRs (30d)
126

Description

One reason to exclude a server is because the server is under too much load, so the goal is to take write load away from the excluded server. However, exclude is going to move shard away from the excluded server in a random order, so it may move a lot of cold data before hitting the hot shards.

If we issue movements to the DD queue at a higher priority if the shard is write hot, we can prioritize doing those excludes before the cold ones.

Contributor guide

Open the contributing guide

Research direction

Start by tracing the exclude workflow and how shard movements are issued to the DD queue. Determine where write-hot shards can be identified and prioritized over cold shards; done means excludes move write-hot shards first rather than in random order.

Written by the indexing model from the issue text.

Assessment

Tech stack
cpp
Domain
databases, distributed-systems
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.