apache / apache/datafusion

[EPIC] Support TPC-DS benchmarks

Open
#4,763 9 comments 3 reactions 1 assignee Claimed by @andygrove View on GitHub
enhancement PROPOSAL EPIC
Dominant language
Rust
Stars
9.3k
Forks
2.4k
Avg merge
3d 7h
Merged PRs (30d)
344

Description

**Is your feature request related to a problem or challenge? Please describe what you are trying to do.**
I would like to be able to run all TPC-DS queries with DataFusion, but some are not yet supported.

- [ ] https://github.com/apache/datafusion/issues/13072
- [ ] https://github.com/apache/datafusion/issues/13073
- [x] https://github.com/apache/datafusion/issues/13074
- [x] https://github.com/apache/datafusion/issues/3770
- [x] https://github.com/apache/datafusion/issues/13993

Old description:
```
I am testing with [SQLBench-DS](https://github.com/sql-benchmarks/sqlbench-ds) and I am seeing some failures. Many of these affect multiple queries but I have just listed a single example query here for each type of error.

- https://github.com/apache/arrow-datafusion/issues/4794
- https://github.com/apache/arrow-datafusion/issues/123
- `At least two values are needed to calculate variance` (q17)
- `The type of Int32 = Int64 of binary physical should be same` (q72)
- `physical plan is not yet implemented for GROUPING aggregate function` (q27)
- `Projections require unique expression names but the expression "MAX(customer_demographics.cd_dep_count)" at position 6 and "MAX(customer_demographics.cd_dep_count)" at position 7 have the same name. Consider aliasing ("AS") one of them.` (q35)
- `The function Stddev does not support inputs of type Decimal128(7, 2).` (q74)
```

**Describe the solution you'd like**
Support all the queries.

**Describe alternatives you've considered**
N/A

**Additional context**
N/A

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.