apache / apache/iceberg-rust

Arrow uint32/64 support

Open
#1,164 11 comments 0 reactions 0 assignees View on GitHub
enhancement
Dominant language
Rust
Stars
1.4k
Forks
567
Avg merge
2d 2h
Merged PRs (30d)
93

Description

### Is your feature request related to a problem or challenge?

`iceberg::spec::Schema::try_from` tries to construct an Iceberg schema from an arrow schema, but does not support converting uint types.

### Describe the solution you'd like

`ArrowSchemaVisitor::primitive` must support uint types, currently throws `Error: DataInvalid => Unsupported Arrow data type: UInt64`

### Willingness to contribute

None

Contributor guide

Open the contributing guide

Research direction

Start at ArrowSchemaVisitor::primitive, the entry point named in the issue, and inspect how existing Arrow primitive types are converted during iceberg::spec::Schema::try_from. Add support for UInt32 and UInt64, then verify that Arrow schemas using those types convert without the reported Unsupported Arrow data type error.

Written by the indexing model from the issue text.

Assessment

Tech stack
rust
Domain
data-engineering
Issue type
Feature
Difficulty
3/5
Estimated time
1-2 days
Activity status
Quiet
Clarity
Mostly clear
Newbie friendliness
65/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.