apache / apache/arrow

[C++][Acero] Asofjoin does not propagate pause upstream

Open
#46,421 3 comments 0 reactions 1 assignee Claimed by @gitmodimo View on GitHub
Component: C++ Type: bug
Dominant language
C++
Stars
17.1k
Forks
4.3k
Avg merge
3d 13h
Merged PRs (30d)
88

Description

### Describe the bug, including details regarding any error messages, version, and platform.

Current implementation of `asofjoin` node ignores pause requests from downstream. This can lead to big memory consumption when downstream nodes process data slower than the join node.

I created [PR46140](https://github.com/apache/arrow/pull/46140) that throttles join processing and input queues propagate pauses upstream.

### Component(s)

C++

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.