apache / apache/gluten

Microbenchmark doesn't support BHJ

Open
#12,504 1 comment 0 reactions 0 assignees View on GitHub
enhancement
Dominant language
Scala
Stars
1.6k
Forks
657
Avg merge
2d 21h
Merged PRs (30d)
85

Description

### Description

Like TPCDS Q67, first stage.

It reports segment fault. Call stack:

```gdb
#0 0x00007ffff1425b9b in JavaVM_::GetEnv (version=65544, penv=0x7fffffff7df8, this=0x0) at /usr/lib/jvm/java-17-openjdk/include/jni.h:1946
#1 gluten::JniHashTableContext::callJavaGet (this=0x7ffff7d74ea0 , id=...)
at /incubator-gluten/cpp/velox/jni/JniHashTable.cc:50
#2 0x00007ffff159ab58 in gluten::SubstraitToVeloxPlanConverter::toVeloxPlan (this=0x7fffffff9ec0, sJoin=...)
at /incubator-gluten/cpp/velox/substrait/SubstraitToVeloxPlan.cc:467
#3 0x00007ffff159a2c9 in gluten::SubstraitToVeloxPlanConverter::toVeloxPlan (this=this@entry=0x7fffffff9ec0, rel=...)
at /incubator-gluten/cpp/velox/substrait/SubstraitToVeloxPlan.cc:1686
#4 0x00007ffff159ce35 in gluten::SubstraitToVeloxPlanConverter::convertSingleInput (rel=..., this=0x7fffffff9ec0)
at /incubator-gluten/cpp/velox/substrait/SubstraitToVeloxPlan.h:273

```

### Gluten version

None

Contributor guide

Open the contributing guide

Research direction

Start by reproducing the BHJ case described as the first stage of TPCDS Q67, then inspect cpp/velox/jni/JniHashTable.cc:50 and cpp/velox/substrait/SubstraitToVeloxPlan.cc:467 using the provided stack trace. Done means the microbenchmark supports this BHJ case without a segmentation fault.

Written by the indexing model from the issue text.

Assessment

Tech stack
cpp, java
Domain
backend, databases
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Quiet
Clarity
Needs clarification
Newbie friendliness
42/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.