apache / apache/gluten

[VL] Results are mismatch with vanilla Spark, it maybe caused by cast(string as bigint)

Open
#4,930 1 comment 0 reactions 0 assignees View on GitHub
bug triage
Dominant language
Scala
Stars
1.6k
Forks
657
Avg merge
2d 14h
Merged PRs (30d)
80

Description

### Backend

VL (Velox)

### Bug description

The following SQL might lead to wrong results, but it's not yet certain if there are other factors involved.
I will try to reproduce later.
```
SELECT deal_id,
spu_id
FROM tableA a LATERAL VIEW explode(split(regexp_replace(spu_list, '\\[|\\]',''),",")) tmp_table AS spu_id
)a
LEFT JOIN (
SELECT cast(spu_id AS bigint) AS spu_id
FROM tableB
)b
ON a.spu_id = b.spu_id
```

### Spark version

None

### Spark configurations

_No response_

### System information

_No response_

### Relevant logs

_No response_

Contributor guide

Open the contributing guide

Research direction

Start by reproducing the provided SQL under VL and vanilla Spark, since the issue provides no files, tests, Spark version, or logs. Isolate whether the cast from string to bigint contributes to the mismatch; done means the cause is identified and the results agree or the remaining factors are documented.

Written by the indexing model from the issue text.

Assessment

Tech stack
sql
Domain
backend, data-engineering
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.