apache / apache/gluten

[CH]add a profile for mergetree build

Open
#6,564 0 comments 0 reactions 0 assignees View on GitHub
enhancement
Dominant language
Scala
Stars
1.6k
Forks
657
Avg merge
2d 21h
Merged PRs (30d)
85

Description

### Description

Currently MergeTree reader/writer for CH backend depends on delta jars. When no delta jars exists in spark jars directory, it will fail even not use MergeTree related feature. Add an option to allow build CH backend without MergeTree, so no delta jars will be needed.
An example to build without MergeTree:
mvn -DskipTests=true -P backends-clickhouse,hadoop-3.3,spark-3.3,spark-ut,-mergetree clean install

Contributor guide

Open the contributing guide

Research direction

Start by running the example Maven command and inspect the build profiles for backends-clickhouse and mergetree. Trace how the MergeTree profile affects the ClickHouse backend build and verify that disabling it allows a successful build without Delta jars while leaving MergeTree-related features disabled.

Written by the indexing model from the issue text.

Assessment

Tech stack
clickhouse, scala
Domain
backend, build-system
Issue type
Feature
Difficulty
3/5
Estimated time
1-2 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
45/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.