apache / apache/gluten

[CH] The test 'test 2-col partitioned table' failed with the Spark 3.5 after rebasing the ch 25.12.10.7

Open
#12,045 0 comments 0 reactions 0 assignees View on GitHub
bug triage
Dominant language
Scala
Stars
1.6k
Forks
657
Avg merge
2d 14h
Merged PRs (30d)
80

Description

### Backend

CH (ClickHouse)

### Bug description

The test 'test 2-col partitioned table' failed with the Spark 3.5 after rebasing the ch 25.12.10.7.
When running test 'test 2-col partitioned table' with the Spark 3.5 + Orc format, it will throw error 'GlutenException: Memory limit exceeded: would use 1.01 GiB (attempt to allocate chunk of 4.10 MiB), maximum: 1.00 GiB.'.
It worked find for the Spark 3.3

### Gluten version

_No response_

### Spark version

None

### Spark configurations

_No response_

### System information

_No response_

### Relevant logs

```bash

```

Contributor guide

Open the contributing guide

Research direction

Locate the test named “test 2-col partitioned table” and run it with Spark 3.5 using ORC, capturing the configuration and full error output. Compare the result with Spark 3.3; done means the two-column partitioned-table test passes without exceeding the 1 GiB memory limit.

Written by the indexing model from the issue text.

Assessment

Tech stack
clickhouse, scala
Domain
databases, testing
Issue type
Bug
Difficulty
3/5
Estimated time
1-2 days
Activity status
Quiet
Clarity
Needs clarification
Newbie friendliness
42/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.