apache / apache/incubator-xtable
Support source/sink for plain Parquet/ORC/Avro Tables
- Dominant language
- Java
- Stars
- 1.2k
- Forks
- 212
- Avg merge
- 4d 9h
- Merged PRs (30d)
- 16
Description
Supporting plain Parquet/ORC/Avro (partitioned as well as unpartitioned) may be useful for "upgrading" legacy data to table formats. Sink may be useful for exporting a specific snapshot for interoperability reasons.
This feature is lower priority, as Iceberg/Delta etc have native support for metadata-only conversions and offer Spark procedures.
Contributor guide
No contributing guide indexed for this repository
Research direction
No files, tests, or entry points are named. Start by reading the repository's existing conversion paths and how Iceberg and Delta support is organized, then determine the source and sink boundaries for plain Parquet, ORC, and Avro. Done means supporting both partitioned and unpartitioned tables for source and sink operations.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- java
- Domain
- data-engineering
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 30/100