apache / apache/sedona

Dynamic Index Build Side is Statically Chosen

Open
#854 4 comments 0 reactions 0 assignees View on GitHub
Dominant language
Java
Stars
2.4k
Forks
784
Avg merge
1d 12h
Merged PRs (30d)
58

Description

## Expected behavior
During dynamic join queries on commutative conditions, the local index is built on whichever side is smaller, and the other side is streamed against it. This likely requires some linear scans prior to running

## Actual behavior
We must specify the side on which to build the index for all partitions apriori when using ```JoinQueries.SpatialJoinQueryFlat```.

## Steps to reproduce the problem
N/A

## Settings
N/A

Contributor guide

Open the contributing guide

Research direction

Start by reading JoinQueries.SpatialJoinQueryFlat and trace how the index-building side is selected for dynamic joins on commutative conditions. The work is done when each partition can build its local index on the smaller side and stream the other side against it, including any required scans before execution.

Written by the indexing model from the issue text.

Assessment

Tech stack
java
Domain
data
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.