apache / apache/datafusion-comet
Spark 4.2: BloomFilter tests fail under Comet
- Dominant language
- Scala
- Stars
- 1.3k
- Forks
- 373
- Avg merge
- 2d 4h
- Merged PRs (30d)
- 198
Description
Comet BloomFilter tests are skipped on Spark 4.2 (`assume(!isSpark42Plus, ...)`) pending investigation of BloomFilter behavior on Spark 4.2.
Affected tests:
- `CometExecRuleSuite`: "CometExecRule should allow BloomFilter mixed Comet partial and Spark final", "... mixed Spark partial and Comet final"
- `CometExec3_4PlusSuite`: "test BloomFilterMightContain can take a constant value input", "test NULL inputs for BloomFilterMightContain", "test BloomFilterMightContain from random input"
These were bulk-deferred to the generic Spark 4.2 tracker in #4126. This issue tracks the specific BloomFilter work so the `assume` guards can be removed.
Contributor guide
Assessment
This issue has not been assessed yet.