ClickHouse / ClickHouse/ClickHouse

Add clickbench on top of iceberg in CI

Open
#89,113 0 comments 0 reactions 0 assignees View on GitHub
comp-ci-infrastructure comp-datalake performance
Dominant language
C++
Stars
49.9k
Forks
9k
Avg merge
21h 32m
Merged PRs (30d)
515

Description

There is a job we run every day and collect performance of ClickHouse in ClickBench on top of MergeTree: [link](https://github.com/ClickHouse/ClickHouse/blob/8e9b48b4508083509ca4b4f30687c416ae68e3cc/ci/jobs/clickbench.py). Since we support `CREATE TABLE`, `INSERT` and all kind of `SELECT` queries we can introduce similar job for Iceberg as well:
1. Need to add new `create.sql`: https://github.com/ClickHouse/ClickHouse/blob/8e9b48b4508083509ca4b4f30687c416ae68e3cc/ci/jobs/scripts/clickbench/create.sql
2. Need to add new job which uses this `create.sql`.

To save costs we can avoid `INSERT` part of ClickBench, however it could be potentially useful.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.