The benchmark results significantly differ from the performance observed in the current service, and the actual performance is considerably worse
- Dominant language
- Scala
- Stars
- 1.6k
- Forks
- 657
- Avg merge
- 2d 14h
- Merged PRs (30d)
- 80
Description
### Backend
VL (Velox)
### Bug description
We did a TPC-H benchmark and found that the time consumption of some SQL increased: q5, q7, q8, q9, q12, q14, q15, q16, especially q14.
Did I make a mistake somewhere?
gluten: build from branch main
data-size:100 G
spark-submit \ --class com.test.RunBenchmark \ --deploy-mode cluster \ --driver-memory 10g \ --executor-cores 4 \ --executor-memory 6G \ --num-executors 20 \ --conf spark.network.timeout=600s \ --conf spark.gluten.loadLibFromJar=true \ --conf spark.plugins=io.glutenproject.GlutenPlugin \ --conf spark.memory.offHeap.enabled=true \ --conf spark.memory.offHeap.size=2g \ --conf spark.gluten.sql.columnar.shuffle.codec=lz4 \ --conf spark.shuffle.manager=org.apache.spark.shuffle.sort.ColumnarShuffleManager \ --conf spark.dynamicAllocation.enabled=false \ --conf spark.default.parallelism=1000 \ --conf spark.kubernetes.container.image=spark-imagesxxx \ /path/gluten-1.0-SNAPSHOT-jar-with-dependencies.jar

### Spark version
Spark-3.2.x
### Spark configurations
spark-submit \ --class com.test.RunBenchmark \ --deploy-mode cluster \ --driver-memory 10g \ --executor-cores 4 \ --executor-memory 6G \ --num-executors 20 \ --conf spark.network.timeout=600s \ --conf spark.gluten.loadLibFromJar=true \ --conf spark.plugins=io.glutenproject.GlutenPlugin \ --conf spark.memory.offHeap.enabled=true \ --conf spark.memory.offHeap.size=2g \ --conf spark.gluten.sql.columnar.shuffle.codec=lz4 \ --conf spark.shuffle.manager=org.apache.spark.shuffle.sort.ColumnarShuffleManager \ --conf spark.dynamicAllocation.enabled=false \ --conf spark.default.parallelism=1000 \ --conf spark.kubernetes.container.image=spark-imagesxxx \ /path/gluten-1.0-SNAPSHOT-jar-with-dependencies.jar
### System information
Velox System Info v0.0.2
Commit: 172820c771c02ea3da08ec496d33ad1f416ce183
CMake Version: 3.16.3
System: Linux-4.14.238-125.422.amzn1.x86_64
Arch: x86_64
C++ Compiler: /usr/bin/c++
C++ Compiler Version: 9.4.0
C Compiler: /usr/bin/cc
C Compiler Version: 9.4.0
CMake Prefix Path: /usr/local;/usr;/;/usr;/usr/local;/usr/X11R6;/usr/pkg;/opt
### Relevant logs
_No response_
Contributor guide
Assessment
This issue has not been assessed yet.