facebook / facebook/rocksdb

Changes in noise in regression test results

Open
#12,288 1 comment 0 reactions 1 assignee Claimed by @adamretter View on GitHub
Dominant language
C++
Stars
32.1k
Forks
6.9k
Avg merge
32m
Merged PRs (30d)
1

Description

> Note: Please use Issues only for bug reports. For questions, discussions, feature requests, etc. post to dev group: https://groups.google.com/forum/#!forum/rocksdb or https://www.facebook.com/groups/rocksdb.dev

### Expected behavior

The performance regression results have low noise

### Actual behavior

They fluctuate a bit, except during August - mid-November 2023. I wonder what happened then to make the results so stable, and whether that situation can be recreated.

### Steps to reproduce the behavior

The dashboard is here - https://search-rocksdb-bench-k2izhptfeap2hjfxteolsgsynm.us-west-2.es.amazonaws.com/_dashboards/app/dashboards#/view/9efe4fc0-fdd9-11ec-9f1d-b7bf4fe8d037. AFAIK it isn't publicly available, but here's a sample -

[
![Screenshot 2024-01-24 at 12 59 34 PM](https://github.com/facebook/rocksdb/assets/4780362/dafef8a0-ff7a-4bb8-bb44-05cc83e1abbe)
](url)

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.