apache / apache/datafusion-comet
Support non-determenistic expression in `explode`
- Dominant language
- Scala
- Stars
- 1.3k
- Forks
- 373
- Avg merge
- 2d 4h
- Merged PRs (30d)
- 198
Description
Comet need to support deterministic expressions in explode to match Spark
```
java.lang.RuntimeException: Error executing SQL 'SELECT id, explode(array(rand(0))) FROM test_explode_int WHERE id = 1' nondeterministic expressions are only allowed in Project, Filter, Aggregate or Window, found:
explode(array(rand(0))),col
in operator Generate explode(array(rand(0))), false, [col#93426].; line 1 pos 0;
```
However the test passed in pure Spark
The same needs to be tested for `explode/posexplode` for regular and outer variants
_Originally posted by @comphead in https://github.com/apache/datafusion-comet/issues/5192#issuecomment-5171362231_
Contributor guide
Assessment
This issue has not been assessed yet.