ClickHouse / ClickHouse/ClickBench

Versions benchmark: Run TPC-H and TPC-DS queries in standard-compatible mode

Open
#1,322 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Shell
Stars
1.1k
Forks
313
Avg merge
2h 43m
Merged PRs (30d)
598

Description

The TPC-H and TPC-DS benchmarks in [ClickBench](https://benchmark.clickhouse.com/versions/) should run with the following session settings to produce official-SQL-compliant results. Compared to running with default settings like today, this is more a nice-to-have since since no official reference files exist for scale factors 40 / 35 (TPC-H / TPC-DS) used by the versions benchmark.

- for TPC-H: https://github.com/ClickHouse/ClickHouse/blob/master/tests/benchmarks/tpc-h/settings.json
- for TPC-DS: https://github.com/ClickHouse/ClickHouse/blob/master/tests/benchmarks/tpc-ds/settings.json

Contributor guide

No contributing guide indexed for this repository

Research direction

Start with the ClickBench versions benchmark at https://benchmark.clickhouse.com/versions/ and inspect how its TPC-H and TPC-DS runs set session options. Compare those settings with tests/benchmarks/tpc-h/settings.json and tests/benchmarks/tpc-ds/settings.json; done means both benchmark families run in standard-compatible mode.

Written by the indexing model from the issue text.

Assessment

Tech stack
shell, sql
Domain
databases
Issue type
Feature
Difficulty
3/5
Estimated time
1-2 days
Activity status
Quiet
Clarity
Mostly clear
Newbie friendliness
58/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.