apache / apache/gluten

[CH] sync spark config `spark.sql.orc.dictionary.key.threshold` to CH settings `output_format_orc_dictionary_key_size_threshold`

Open
#7,266 0 comments 0 reactions 0 assignees View on GitHub
enhancement
Dominant language
Scala
Stars
1.6k
Forks
657
Avg merge
2d 14h
Merged PRs (30d)
80

Description

### Description

sync spark config `spark.sql.orc.dictionary.key.threshold` to CH settings `output_format_orc_dictionary_key_size_threshold`

Contributor guide

Open the contributing guide

Research direction

Start by locating where Spark ORC configuration is translated into ClickHouse settings, using the two configuration names as search terms. Verify the mapping with the repository's existing configuration or integration tests, if present; done means the Spark threshold is applied as output_format_orc_dictionary_key_size_threshold.

Written by the indexing model from the issue text.

Assessment

Tech stack
clickhouse, scala
Domain
backend, databases
Issue type
Feature
Difficulty
3/5
Estimated time
1-2 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
38/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.