apache / apache/datafusion-ballista

Left/full outer join incorrect for CollectLeft / broadcast

Open
#1,055 7 comments 0 reactions 0 assignees View on GitHub
bug correctness
Dominant language
Rust
Stars
2.1k
Forks
320
Avg merge
1d 22h
Merged PRs (30d)
66

Description

**Describe the bug**
See discussion here https://github.com/apache/datafusion/issues/12454

The "broadcast join" (CollectLeft) is wrong for certain join types which produce results on unmatched left rows.

**To Reproduce**
Run a broadcast join with left / full outer on more than one node

**Expected behavior**

**Additional context**

Contributor guide

Open the contributing guide

Research direction

Start by reading the linked DataFusion discussion and reproducing a broadcast join with CollectLeft using left and full outer joins on more than one node. Compare the results for unmatched left rows and use that behavior to define done: those rows should be returned correctly for the affected join types.

Written by the indexing model from the issue text.

Assessment

Tech stack
rust
Domain
databases, distributed-systems
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Quiet
Clarity
Needs clarification
Newbie friendliness
42/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.