apache / apache/arrow-java

Support message level custom_metadata on DictionaryBatch (IPC Message field)

Open
#1,043 1 comment 0 reactions 0 assignees View on GitHub
Type: enhancement
Dominant language
Java
Stars
94
Forks
152
Avg merge
3d 16h
Merged PRs (30d)
11

Description

### Describe the enhancement requested

Analogous to https://github.com/apache/arrow-java/issues/1035 but for DictionaryBatch.

The Arrow IPC format supports Message level `custom_metadata`, see https://arrow.apache.org/docs/format/Columnar.html#custom-application-metadata and https://github.com/apache/arrow/blob/main/format/Message.fbs#L154

The DictionaryBatch in this implementation currently has no support for this field.

Contributor guide

Open the contributing guide

Research direction

Compare the DictionaryBatch implementation with the analogous work in Apache Arrow issue 1035, and inspect the IPC Message.fbs definition for the message-level custom_metadata field. Done means DictionaryBatch supports that field consistently with the Arrow IPC format; verify the behavior with the repository's existing tests.

Written by the indexing model from the issue text.

Assessment

Tech stack
java
Domain
data
Issue type
Feature
Difficulty
3/5
Estimated time
1-2 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
42/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.