facebook / facebook/rocksdb

Mutex bottleneck upon reading from database

Open
#5,091 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
C++
Stars
32.1k
Forks
6.9k
Avg merge
32m
Merged PRs (30d)
1

Description

This is using 5.14.3 on Windows, I believe I am only able to read about 15MB/s from the database or so. When I profiled rocksdb, it appears that resizing of a vector when reading data in is causing a big bottleneck. It is unclear if there is a setting to fix this value, as making the block size bigger did not work.
![Capture](https://user-images.githubusercontent.com/648433/54796821-08f4eb80-4c0f-11e9-929c-bda18599c08f.PNG)

Contributor guide

Open the contributing guide

Research direction

No source file, test, or entry point is named. Start by reproducing the Windows read-throughput issue on RocksDB 5.14.3 and reviewing the supplied profile for vector resizing during reads; compare results with different block-size settings. Done means the bottleneck is identified and a verified change or configuration resolves the reported throughput problem.

Written by the indexing model from the issue text.

Assessment

Tech stack
cpp
Domain
databases, performance
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.