apache / apache/datafusion

Lack of benchmarks for RepartionExec

Open
#25,127 0 comments 0 reactions 0 assignees View on GitHub
enhancement
Dominant language
Rust
Stars
9.3k
Forks
2.4k
Avg merge
3d 7h
Merged PRs (30d)
344

Description

### Is your feature request related to a problem or challenge?

we need a way to measure improvements in #7001 that the tpch E2E benchmarks may not capture

### Describe the solution you'd like

add a new benchmark suite that targets repartionExec

### Describe alternatives you've considered

n/a

### Additional context

#7001

Contributor guide

Open the contributing guide

Research direction

Start by reading the existing TPC-H E2E benchmarks and the context of #7001, then locate the RepartitionExec entry point in DataFusion. Add a benchmark suite that specifically exercises RepartitionExec and produces measurements that can reveal improvements not captured by TPC-H; done means the suite runs and reports comparable results.

Written by the indexing model from the issue text.

Assessment

Tech stack
rust
Domain
performance, testing
Issue type
Feature
Difficulty
3/5
Estimated time
1-2 days
Activity status
Active
Clarity
Mostly clear
Newbie friendliness
64/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.