apache / apache/datafusion-comet

[EPIC] TPC-H performance improvements

Open
#2,004 2 comments 0 reactions 0 assignees View on GitHub
enhancement EPIC
Dominant language
Scala
Stars
1.3k
Forks
373
Avg merge
2d 6h
Merged PRs (30d)
190

Description

### What is the problem the feature request solves?

The epic is supposed to track a progress in improving TPC-H query performance and replaces outdated #391 .

Please find below query comparison Comet 0.9.0 vs Gluten 1.4.0 (TPC-H @ 100GB)

Image

Feel free to convert the task into issue and attach performance findings there

- [ ] q1
- [ ] q2
- [ ] q3
- [ ] q4
- [ ] q5
- [ ] q6
- [ ] q7
- [ ] q8
- [x] #2006
- [ ] q10
- [ ] q11
- [ ] q12
- [ ] q13
- [ ] q14
- [ ] q15
- [ ] q16
- [ ] https://github.com/apache/datafusion-comet/issues/2008
- [ ] q18
- [ ] q19
- [ ] q20
- [ ] q21
- [ ] q22

The PR how to run benchmarks https://github.com/apache/datafusion-comet/pull/2025

### Describe the potential solution

_No response_

### Additional context

_No response_

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.