apache / apache/incubator-xtable

Support source/sink for plain Parquet/ORC/Avro Tables

Open
#166 9 comments 0 reactions 0 assignees View on GitHub
enhancement good first issue
Dominant language
Java
Stars
1.2k
Forks
212
Avg merge
4d 9h
Merged PRs (30d)
16

Description

Supporting plain Parquet/ORC/Avro (partitioned as well as unpartitioned) may be useful for "upgrading" legacy data to table formats. Sink may be useful for exporting a specific snapshot for interoperability reasons.

This feature is lower priority, as Iceberg/Delta etc have native support for metadata-only conversions and offer Spark procedures.

Contributor guide

No contributing guide indexed for this repository

Research direction

No files, tests, or entry points are named. Start by reading the repository's existing conversion paths and how Iceberg and Delta support is organized, then determine the source and sink boundaries for plain Parquet, ORC, and Avro. Done means supporting both partitioned and unpartitioned tables for source and sink operations.

Written by the indexing model from the issue text.

Assessment

Tech stack
java
Domain
data-engineering
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
30/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.