apache / apache/gluten

The benchmark results significantly differ from the performance observed in the current service, and the actual performance is considerably worse

Open
#3,209 6 comments 0 reactions 0 assignees View on GitHub
bug triage
Dominant language
Scala
Stars
1.6k
Forks
657
Avg merge
2d 14h
Merged PRs (30d)
80

Description

### Backend

VL (Velox)

### Bug description

We did a TPC-H benchmark and found that the time consumption of some SQL increased: q5, q7, q8, q9, q12, q14, q15, q16, especially q14.
Did I make a mistake somewhere?

gluten: build from branch main
data-size:100 G
spark-submit \ --class com.test.RunBenchmark \ --deploy-mode cluster \ --driver-memory 10g \ --executor-cores 4 \ --executor-memory 6G \ --num-executors 20 \ --conf spark.network.timeout=600s \ --conf spark.gluten.loadLibFromJar=true \ --conf spark.plugins=io.glutenproject.GlutenPlugin \ --conf spark.memory.offHeap.enabled=true \ --conf spark.memory.offHeap.size=2g \ --conf spark.gluten.sql.columnar.shuffle.codec=lz4 \ --conf spark.shuffle.manager=org.apache.spark.shuffle.sort.ColumnarShuffleManager \ --conf spark.dynamicAllocation.enabled=false \ --conf spark.default.parallelism=1000 \ --conf spark.kubernetes.container.image=spark-imagesxxx \ /path/gluten-1.0-SNAPSHOT-jar-with-dependencies.jar
![image](https://github.com/oap-project/gluten/assets/74519465/5990491c-18fe-4557-8ea3-fdc00b956f06)

### Spark version

Spark-3.2.x

### Spark configurations

spark-submit \ --class com.test.RunBenchmark \ --deploy-mode cluster \ --driver-memory 10g \ --executor-cores 4 \ --executor-memory 6G \ --num-executors 20 \ --conf spark.network.timeout=600s \ --conf spark.gluten.loadLibFromJar=true \ --conf spark.plugins=io.glutenproject.GlutenPlugin \ --conf spark.memory.offHeap.enabled=true \ --conf spark.memory.offHeap.size=2g \ --conf spark.gluten.sql.columnar.shuffle.codec=lz4 \ --conf spark.shuffle.manager=org.apache.spark.shuffle.sort.ColumnarShuffleManager \ --conf spark.dynamicAllocation.enabled=false \ --conf spark.default.parallelism=1000 \ --conf spark.kubernetes.container.image=spark-imagesxxx \ /path/gluten-1.0-SNAPSHOT-jar-with-dependencies.jar

### System information

Velox System Info v0.0.2
Commit: 172820c771c02ea3da08ec496d33ad1f416ce183
CMake Version: 3.16.3
System: Linux-4.14.238-125.422.amzn1.x86_64
Arch: x86_64
C++ Compiler: /usr/bin/c++
C++ Compiler Version: 9.4.0
C Compiler: /usr/bin/cc
C Compiler Version: 9.4.0
CMake Prefix Path: /usr/local;/usr;/;/usr;/usr/local;/usr/X11R6;/usr/pkg;/opt

### Relevant logs

_No response_

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.