apache / apache/arrow

[Ruby] Add builder API for red-arrow-format

Open
#50,382 6 comments 0 reactions 0 assignees View on GitHub
Component: Ruby Type: enhancement
Dominant language
C++
Stars
17.1k
Forks
4.3k
Avg merge
3d 13h
Merged PRs (30d)
88

Description

### Describe the enhancement requested

red-arrow-format is a pure Ruby Apache Arrow reader/writer implementation. It can write Apache Arrow IPC file/streaming format data but users need to build Apache Arrow in-memory layout data by themselves. For example, `[1, 2, 3].pack("l") + padding` for int32 array. It's inconvenient. We should provide builder API for easy to build Apache Arrow in-memory layout data.

### Component(s)

Ruby

Contributor guide

Open the contributing guide

Research direction

The issue identifies red-arrow-format's pure Ruby reader/writer and existing Apache Arrow IPC file and streaming support, but no files or tests. Start by locating that Ruby implementation and reviewing how callers currently construct in-memory layouts. Done should mean a defined builder API with tests showing that it produces the required Apache Arrow in-memory layout data without manual packing and padding.

Written by the indexing model from the issue text.

Assessment

Tech stack
ruby
Domain
data-engineering
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Active
Clarity
Needs clarification
Newbie friendliness
38/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.