apache / apache/hudi

Add documentation on any unsupported features for existing readers when written by 1.x

Open
#17,263 1 comment 0 reactions 0 assignees View on GitHub
area:reader from-jira priority:high type:devtask
Dominant language
Java
Stars
6.2k
Forks
2.5k
Avg merge
2d 8h
Merged PRs (30d)
111

Description

We wanted to support reading 1.x tables in 0.16.0 reader. (both table version 6/7)

 

But certain features could be unsupported. Lets call out all of them which might be unsupported. 

To name a few: 
- partial update

- deletion vector

- sec index. 

 

## JIRA info

- Link: https://issues.apache.org/jira/browse/HUDI-7889
- Type: Sub-task
- Parent: https://issues.apache.org/jira/browse/HUDI-8158

Contributor guide

No contributing guide indexed for this repository

Research direction

Start by reviewing the 0.16.0 reader's support for table versions 6 and 7, then investigate the listed partial update, deletion vector, and secondary-index features. Record every unsupported feature for tables written by 1.x, and verify that the resulting documentation clearly states the compatibility limitations.

Written by the indexing model from the issue text.

Assessment

Domain
data-engineering, documentation
Issue type
Documentation
Difficulty
4/5
Estimated time
3-5 days
Activity status
Active
Clarity
Mostly clear
Newbie friendliness
45/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.