[VL] Results are mismatch with vanilla Spark, it maybe caused by cast(string as bigint)
- Dominant language
- Scala
- Stars
- 1.6k
- Forks
- 657
- Avg merge
- 2d 14h
- Merged PRs (30d)
- 80
Description
### Backend
VL (Velox)
### Bug description
The following SQL might lead to wrong results, but it's not yet certain if there are other factors involved.
I will try to reproduce later.
```
SELECT deal_id,
spu_id
FROM tableA a LATERAL VIEW explode(split(regexp_replace(spu_list, '\\[|\\]',''),",")) tmp_table AS spu_id
)a
LEFT JOIN (
SELECT cast(spu_id AS bigint) AS spu_id
FROM tableB
)b
ON a.spu_id = b.spu_id
```
### Spark version
None
### Spark configurations
_No response_
### System information
_No response_
### Relevant logs
_No response_
Contributor guide
Research direction
Start by reproducing the provided SQL under VL and vanilla Spark, since the issue provides no files, tests, Spark version, or logs. Isolate whether the cast from string to bigint contributes to the mismatch; done means the cause is identified and the results agree or the remaining factors are documented.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- sql
- Domain
- backend, data-engineering
- Issue type
- Bug
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100