When the Parquet row group size is set to 8M, certain SQL queries in TPC-DS may result in a core dump.
- Dominant language
- Scala
- Stars
- 1.6k
- Forks
- 657
- Avg merge
- 2d 14h
- Merged PRs (30d)
- 80
Description
### Backend
VL (Velox)
### Bug description
When I use the default parquet rowGroupSize, it runs normally. However, when I change the parquet rowGroupSize, some TPC-DS SQL queries result in a core dump.I noticed that there were some issues similar to this one before. I modified cpp/core/jni/JniCommon.h, but the problem still persists.
### Gluten version
Gluten-1.3
### Spark version
Spark-3.3.x
### Spark configurations
_No response_
### System information
_No response_
### Relevant logs
```bash
Stack: [0x0000ffffb56c5000,0x0000ffffb58c5000], sp=0x0000ffffb58bc0e0, free space=2012k
Native frames: (J=compiled Java code, j=interpreted, Vv=VM code, C=native code)
V [libjvm.so+0x8126c0] Method::bci_from(unsigned char*) const+0x0
V [libjvm.so+0x5def10] InterpreterRuntime::create_exception(JavaThread*, char*, char*)+0x230
Internal exceptions (10 events):
Event: 41.479 Thread 0x0000ffffb0012800 Exception (0x000000062210abd0) thrown at [/home/hu
Event: 41.479 Thread 0x0000ffffb0012800 Exception (0x000000062211
Event: 41.480 Thread 0x0000ffffb0012800 Exception (0x000000062211d7b0) thrown at [/home/jdk-build/src/hotspot/src
Event: 41.484 Thread 0x0000ffffb0012800 Exception (0x0000000622189468) thrown at [/home/huawe
Event: 41.680 Thread 0x0000ffffb0012800 Exception (0x000000062304fd58) thrown at [/home/jdk-build/src/hotsp
Event: 41.741 Thread 0x0000ffffb0012800 Exception (0x00000006234177b8) thrown at [/home/jdk-build/src/hotspot/
Event: 41.741 Thread 0x0000ffffb0012800 Exception (0x000000062341ce78) thrown at [/home/jdk-build/src/hotspot/s
Event: 41.751 Thread 0x0000ffffb0012800 Exception (0x0
Event: 41.848 Thread 0x0000ffffb0012800 Exception (0x0000000623adeea0) th
Event: 41.848 Thread 0x0000ffffb0012800 Exception (0x0000000623ae7c20) thrown at [/home
gdb logs:
#0 0x0000ffff9c990e10 in ?? () from /usr/lib64/libc.so.6
#1 0x0000ffff9c949fbc in raise () from /usr/lib64/libc.so.6
#2 0x0000ffff9c937d70 in abort () from /usr/lib64/libc.so.6
#3 0x0000ffff9c406bbc in os::abort(bool) () from /usr/local/jdk1.8.0_342/jre/lib/aarch64/server/libjvm.so
#4 0x0000ffff9c5c7fcc in VMError::report_and_die() () from /usr/local/jdk1.8.0_342/jre/lib/aarch64/server/libjvm.so
#5 0x0000ffff9c5c8ed8 in crash_handler(int, siginfo_t*, void*) () from /usr/local/jdk1.8.0_342/jre/lib/aarch64/server/libjvm.so
#6
#7 0x0000ffff9c3806bc in Method::name_and_sig_as_C_string(char*, int) const () from /usr/local/jdk1.8.0_342/jre/lib/aarch64/server/libjvm.so
#8 0x0000ffff9c03fd94 in frame::print_on_error(outputStream*, char*, int, bool) const () from /usr/local/jdk1.8.0_342/jre/lib/aarch64/server/libjvm.so
#9 0x0000ffff9c5c59cc in VMError::print_stack_trace(outputStream*, JavaThread*, char*, int, bool) [clone .part.13] () from /usr/local/jdk1.8.0_342/jre/lib/aarch64/server/libjvm.so
#10 0x0000ffff9c5c6a5c in VMError::report(outputStream*) () from /usr/local/jdk1.8.0_342/jre/lib/aarch64/server/libjvm.so
#11 0x0000ffff9c5c7b34 in VMError::report_and_die() () from /usr/local/jdk1.8.0_342/jre/lib/aarch64/server/libjvm.so
#12 0x0000ffff9c5c8ed8 in crash_handler(int, siginfo_t*, void*) () from /usr/local/jdk1.8.0_342/jre/lib/aarch64/server/libjvm.so
#13
#14 0x0000ffff9c3806bc in Method::name_and_sig_as_C_string(char*, int) const () from /usr/local/jdk1.8.0_342/jre/lib/aarch64/server/libjvm.so
#15 0x0000ffff9c03fd94 in frame::print_on_error(outputStream*, char*, int, bool) const () from /usr/local/jdk1.8.0_342/jre/lib/aarch64/server/libjvm.so
#16 0x0000ffff9bfb63a8 in print_native_stack(outputStream*, frame, Thread*, char*, int) () from /usr/local/jdk1.8.0_342/jre/lib/aarch64/server/libjvm.so
#17 0x0000ffff9c5c6e50 in VMError::report(outputStream*) () from /usr/local/jdk1.8.0_342/jre/lib/aarch64/server/libjvm.so
#18 0x0000ffff9c5c7b34 in VMError::report_and_die() () from /usr/local/jdk1.8.0_342/jre/lib/aarch64/server/libjvm.so
#19 0x0000ffff9c411b74 in JVM_handle_linux_signal () from /usr/local/jdk1.8.0_342/jre/lib/aarch64/server/libjvm.so
#20 0x0000ffff9c403a0c in signalHandler(int, siginfo_t*, void*) () from /usr/local/jdk1.8.0_342/jre/lib/aarch64/server/libjvm.so
#21
#22 0x0000ffff9c3816c0 in Method::bci_from(unsigned char*) const () from /usr/local/jdk1.8.0_342/jre/lib/aarch64/server/libjvm.so
#23 0x0000ffff9c14d6f0 in InterpreterRuntime::note_trap(JavaThread*, int, Thread*) () from /usr/local/jdk1.8.0_342/jre/lib/aarch64/server/libjvm.so
#24 0x0000ffff9c14df10 in InterpreterRuntime::create_exception(JavaThread*, char*, char*) () from /usr/local/jdk1.8.0_342/jre/lib/aarch64/server/libjvm.so
```
Contributor guide
Assessment
This issue has not been assessed yet.