apache / apache/arrow

[C++] [Python] Make a user-defined table from a generator

Open
#33,879 1 comment 0 reactions 0 assignees View on GitHub
Component: C++ Component: Python Type: enhancement
Dominant language
C++
Stars
17.1k
Forks
4.3k
Avg merge
3d 18h
Merged PRs (30d)
91

Description

### Describe the enhancement requested

Allow the user to register a UDT by providing a batch generator. This is a follow-up task for #14682 (see [this post](https://github.com/apache/arrow/pull/14682/#discussion_r1086924083)).

### Component(s)

C++, Python

Contributor guide

Open the contributing guide

Research direction

Start by reading follow-up issue #14682 and the linked discussion in Apache Arrow pull request #14682. Identify the existing user-defined table registration path and how batch generators are represented in both C++ and Python; done means users can register a UDT by supplying a batch generator, with the relevant behavior covered by tests.

Written by the indexing model from the issue text.

Assessment

Tech stack
cpp, python
Domain
data
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
30/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.