[VL] Result mismatch issues tracker
- Dominant language
- Scala
- Stars
- 1.6k
- Forks
- 657
- Avg merge
- 2d 14h
- Merged PRs (30d)
- 80
Description
### Backend
VL (Velox)
### Bug description
There are several data mismatch issues either related with operator or functions. Some of the fixes are landed in Gluten, and some are in Velox repo.
We will use this issue to track the status as these are critical for production envs.
- [x] complex datatype return wrong value, disabled in Gluten now
- [x] parquet scan + filter pushdown wrongly return "", should return null.
- [x] distinct hash agg + spill returned duplicated keys.
- [x] max_by function return wrong result
- [x] sortBeforeRepartition
- [ ] cast(sum(decmial(20,4)), float)
- [x] get_json_object({"dScore":0.0215434648799772}, "$.dScore") (Fixed in Velox)
- [ ] cast(string as bigint)
- [x] cast(double as decimal)
- [ ] array_size(null) (issue: https://github.com/apache/incubator-gluten/issues/5248)
- [x] round(avg(cast(col as double)), 4) #5366
- [x] isNull and isNotNull in filter condition #5670
- [x] from_unixtime with overflowed (Fixed by https://github.com/facebookincubator/velox/pull/9836)
- [ ] date_format (https://github.com/apache/incubator-gluten/issues/5524)
- [x] cast integer as binary (https://github.com/apache/incubator-gluten/issues/5073)
- [x] regexp_replace('a{bc', '\\{', '\\[') (#6224)
- [ ] LEGACY timeParserPolicy (#6227)
- [ ] FlushableAgg (#6630)
- [ ] if expression (#6673)
- [ ] weekOfYear (#6784)
- [ ] round (#6827)
- [ ] cast string as date (#6828)
- [ ] nested decimal arithmetic expressions (#7082)
- [ ] date format week year (#7069)
- [ ] Large timestamp outside of range (#7109)
- [ ] Aggregate window gets the wrong result (#7194)
- [x] Diff of in_or_and (#7362)
- [ ] hash agg output wrong result (#7494)
- [ ] cast double as string (#7730)
- [ ] Cast string to integral type does not ignore ISO control characters (#7749)
- [ ] get_json_object (#7777)
- [ ] CollectList (#8184)
- [ ] get_json_object function with a string wrapped in double quotes (#8754)
- [x] Native Scan operator incurred inaccuracy in some filter cases (#8764)
- [x] Result mismatch when BHJ with left semi join (#8787)
- [x] to_timestamp with fraction of seconds (#8858)
- [ ] get_json_object('{"c": "1", "a":""""}','$.c') (#9732)
Contributor guide
Assessment
This issue has not been assessed yet.