cockroachdb / cockroachdb/pebble

db: investigate optimizations for special keys (locks, intents, txn records)

Open
#3,958 1 comment 0 reactions 0 assignees View on GitHub
A-storage C-performance T-storage
Dominant language
Go
Stars
6k
Forks
584
Avg merge
16h 35m
Merged PRs (30d)
5

Description

In addition to keys containing SQL table data, CRDB transactions read and write other internal keys like locks, intents, txn records. These keys have very special access patterns and can likely benefit from targeted optimizations. They also take up a small fraction of the storage space so we can trade off space for efficiency.

Some ideas of what tweaks we could explore for these keys:
- larger bloom filters, use of bloom filters on L6
- fewer LSM levels
- smaller sstables
- reduced compression

We would need #3957 to be able to break down the work we do for these keys in various workloads.

Long term, it would be ideal if Pebble detected special patterns automatically. But in the short-to-medium term, we can explicitly configure Pebble with specific hints for parts of the keyspace.

Jira issue: PEBBLE-261

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.