dolthub / dolthub/dolt

remote replica concurrent transaction start latency

Open
#5,880 0 comments 0 reactions 0 assignees View on GitHub
performance replication
Dominant language
Go
Stars
24.4k
Forks
873
Avg merge
1d 5h
Merged PRs (30d)
108

Description

When there is data to pull for a remote replica, we serialize transaction starts to make sure only one remote pull happens at a time. Under heavy write throughput, customers with concurrent reads have observed increasing latency on successive client reads when there is data to pull, e.g.:

Connection 1: 500ms
Connection 2: 1000ms
Connection 3: 1500ms

This is an indication that these clients are queueing up behind one another and then doing their own pull after waiting for the previous client to complete its pull.

Expected behavior is that any transaction that was waiting on another to complete a pull uses that last successful pull as its transaction start point, rather than start its own pull.

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.