apache / apache/hudi-rs

avro-arrow conversion support union type with multiple non-null types

Open
#370 0 comments 0 reactions 0 assignees View on GitHub
refactor rust
Dominant language
Rust
Stars
279
Forks
67
Avg merge
3d 1h
Merged PRs (30d)
40

Description

This will greatly simplify in creating arrow record batch for delete log block, as noted in `avro_schema_for_delete_record()`

Contributor guide

Open the contributing guide

Research direction

Start by locating avro_schema_for_delete_record() and the Avro-to-Arrow conversion code it uses. Trace how unions are handled, then verify that unions containing multiple non-null types can produce an Arrow record batch for the delete log block; the issue names no tests or specific files to run.

Written by the indexing model from the issue text.

Assessment

Tech stack
rust
Domain
data-engineering
Issue type
Feature
Difficulty
3/5
Estimated time
1-2 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
42/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.