apache / apache/bookkeeper

RocksDB compaction relative

Open
#1,370 0 comments 0 reactions 0 assignees View on GitHub
area/bookie triage/week-10 type/question
Dominant language
Java
Stars
2k
Forks
976
Avg merge
6d 15h
Merged PRs (30d)
7

Description

**QUESTION**
When we use RocksDB as storage for index info, we treat 'ledgerId + entryId' as key in RocksDB. Imagine one case, we have too much ledgers, after put one ledger's index into RocksDB, we put another ledger's index info to it, then RocksDB has to sort these data according to 'ledgerId + entryId' key, these sorting and following compaction will cause some overhead. As @sijie suggested, this [compaction strategy ](https://github.com/facebook/rocksdb/blob/master/include/rocksdb/utilities/table_properties_collectors.h#L23-L27) in RocksDB is helpful, although we haven't active this by default. If I‘m not mistaken, @merlimat introduced RocksDB as a storage for index, so call for your analysis too.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.