cockroachdb / cockroachdb/cockroach

kvserver: limit replica catchup concurrency during Raft scheduling

Open
#103,844 5 comments 0 reactions 0 assignees View on GitHub
A-kv-replication C-enhancement O-support P-3 T-kv
Dominant language
Go
Stars
32.5k
Forks
4.1k
PR merge metrics
PR metrics pending

Description

If many replicas have fallen severely behind on log application, we should consider limiting the number of concurrent replicas doing catchup, to prevent resource exhaustion and scheduling starvation of other ranges. In sum, the overall catchup should take the same time, but this would allow ranges to come online sooner, and prevent e.g. memory blowup across many replicas pulling the full 64 MB command batch into memory at the same time.

Jira issue: CRDB-28229

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.