apache / apache/gluten

gluten spill disk is much larger than spark spill

Open
#9,983 2 comments 0 reactions 0 assignees View on GitHub
bug triage
Dominant language
Scala
Stars
1.6k
Forks
657
Avg merge
2d 14h
Merged PRs (30d)
80

Description

### Backend

VL (Velox)

### Bug description

During the process of running SQL, I found that the spill disk and spill memory of gluten are often much larger than those of spark, which leads to the execution time of gluten much longer than those of spark.

### Gluten version

Gluten-1.3

### Spark version

Spark-3.2.x

### Spark configurations

_No response_

### System information

_No response_

### Relevant logs

```bash

```

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.