facebook / facebook/rocksdb

Please solve your RocksDB repairer context switch overhead or make it parallel.

Open
#7,945 0 comments 0 reactions 0 assignees View on GitHub
enhancement up-for-grabs
Dominant language
C++
Stars
32.1k
Forks
6.9k
Avg merge
32m
Merged PRs (30d)
1

Description

It is currently used in Openethereum.

ssd speed considerably increased since the time it was designed. In my case, I’m seeing currently use 100% cpu on 1 thread and spend 20% in kernel time under Linux. This results in a constant read speed of sst files at 700Mb/s on my Xeon 6250L well below the capacity of my ssd and without switching back to rust code (it’s the same function in the Rocksdb library that executes during hours).

If not improving cpu latency, please at least make the recovery parallel.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.