apache / apache/fluss

[Benchmark] Add E2E Benchmark Support for KV and LOG Workloads

Open
#1,332 10 comments 0 reactions 0 assignees View on GitHub
Dominant language
Java
Stars
2.1k
Forks
625
Avg merge
3d 14h
Merged PRs (30d)
97

Description

### Search before asking

- [x] I searched in the [issues](https://github.com/alibaba/fluss/issues) and found nothing similar.

### Description

Currently, we lack an end-to-end (E2E) benchmark tool to efficiently generate performance reports for various workloads. This makes it difficult to evaluate the performance impact of every code change.

We should introduce a convenient E2E benchmark suite. It can be used to build a daily performance regression test job and also run in a local environment during feature development.

### Willingness to contribute

- [ ] I'm willing to submit a PR!

Contributor guide

No contributing guide indexed for this repository

Research direction

Start by examining the repository's existing benchmark and end-to-end test infrastructure, then identify how KV and LOG workloads can be generated and measured. Done means a convenient suite produces performance reports for both workloads and can support daily regression jobs as well as local feature development.

Written by the indexing model from the issue text.

Assessment

Tech stack
java
Domain
data-engineering, performance, testing-qa
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.