apache / apache/arrow

[C++] Support batch size in user-defined tabular functions

Open
#33,612 1 comment 0 reactions 0 assignees View on GitHub
Component: C++ Type: enhancement
Dominant language
C++
Stars
17.1k
Forks
4.3k
Avg merge
3d 13h
Merged PRs (30d)
88

Description

### Describe the enhancement requested

Currently (in a mature [PR](https://github.com/apache/arrow/pull/14682/)), the UDTF code does not respect the batch size provided in the context. See also [this post](https://github.com/apache/arrow/pull/14682/#discussion_r1057788434).

### Component(s)

C++

Contributor guide

Open the contributing guide

Research direction

Start by reviewing the UDTF code and mature PR #14682, including the linked discussion about batch size. Trace how the batch size is provided in the context and identify where user-defined tabular functions currently ignore it. Done means UDTFs respect the context-provided batch size.

Written by the indexing model from the issue text.

Assessment

Tech stack
cpp
Domain
data-engineering
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.