apache / apache/datafusion-comet
Add support for spilling in hash joins
Open
enhancement
- Dominant language
- Scala
- Stars
- 1.3k
- Forks
- 373
- Avg merge
- 2d 4h
- Merged PRs (30d)
- 198
Description
### What is the problem the feature request solves?
One of the major limitations of Comet today is that there is no spilling support for hash joins. We have to manually disable hash join support for queries that cause OOM during hash joins, which isn't ideal.
### Describe the potential solution
_No response_
### Additional context
_No response_
Contributor guide
Assessment
This issue has not been assessed yet.