cockroachdb / cockroachdb/cockroach

kvserver: investigate mvcc gc queue overload

Open
#156,553 0 comments 0 reactions 0 assignees View on GitHub
C-enhancement P-3 T-kv
Dominant language
Go
Stars
32.5k
Forks
4.1k
PR merge metrics
PR metrics pending

Description

I a recent experiment, I forced all replicas to be enqueued to the MVCC GC queue every 10 minutes. I ran sysbench write-only, and noticed that the performance took about 10% hit ~10 minutes after the workload started, probably because of MVCC GC.

I think we could investigate what happens during the MVCC GC, and if we can potentially come up with some potential optimizations. I think there are 2 things that happen: (1) MVCC GC queue + scanning and deleting the data, and (2) pebble compactions that happen after that. I think both (1) and (2) combined caused the performance to take the 10% hit.

Jira issue: CRDB-56056

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.