apache / apache/arrow-nanoarrow

Use ArrayView appender to simplify array construction in R and Python bindings

Open
#939 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
C
Stars
249
Forks
68
Avg merge
2d 21h
Merged PRs (30d)
11

Description

In https://github.com/apache/arrow-nanoarrow/pull/930 we implement an appender that can append an arbitrary ArrowArrayView storage to an ArrowArray in append mode. In the R and Python bindings we allow a schema request, and there are a few cases where we can probably use the appender to help.

This will also give some more realistic traffic to the new functions, so we can catch any other potential issues.

Contributor guide

No contributing guide indexed for this repository

Research direction

Start by reading the appender implementation in PR #930, then inspect the R and Python binding paths that handle schema requests. Identify the cases where the appender can replace existing array-construction logic, and verify that the new functions receive realistic binding traffic without changing current behavior.

Written by the indexing model from the issue text.

Assessment

Tech stack
c, python, r
Domain
data-engineering
Issue type
Refactor
Difficulty
4/5
Estimated time
3-5 days
Activity status
Active
Clarity
Needs clarification
Newbie friendliness
45/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.