apple / apple/foundationdb

Ratekeeper uses an inaccurate lower bound for the released transaction rate

Open
#371 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
C++
Stars
16.7k
Forks
1.6k
Avg merge
1d 20h
Merged PRs (30d)
126

Description

Ratekeeper computes a lower bound for the number of transactions being released as the total rate of bytes being made durable across all storage and log servers divided by the max transaction size (10MB). For various reasons (e.g. replication, queue overhead, duplication of log and storage), this is not accurate and under some workloads it can lead to a significant overestimate for the number of transactions taking place. As a result, ratekeeper may allow resources to run away inadvertently.

Contributor guide

Open the contributing guide

Research direction

The issue names Ratekeeper but no source file, test, or entry point. Start by locating its released-transaction-rate calculation and review how durable bytes, replication, queue overhead, and duplicated log/storage traffic affect it. Done requires a decided replacement lower bound and coverage for workloads where the current estimate overstates transactions.

Written by the indexing model from the issue text.

Assessment

Tech stack
cpp
Domain
databases, distributed-systems
Issue type
Bug
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.