apache / apache/hudi

Schema attribute of commit metadata should use table schema

Open
#16,729 1 comment 0 reactions 1 assignee Assigned to @yihua View on GitHub
area:core from-jira priority:high type:bug
Dominant language
Java
Stars
6.2k
Forks
2.5k
Avg merge
2d 8h
Merged PRs (30d)
111

Description

In RFC 82 we found it is very hard to extract the table schema at a given point in time from historical completed instants. It is because they either does not write table schema when they tries to commit or they write the writer schema they use instead of table schema.

 

In RFC 82 we addressed the issue partially for OCC multi-writer case. For commits from table services,  single writer case and NBCC we also need to enforce this rule

## JIRA info

- Link: https://issues.apache.org/jira/browse/HUDI-8528
- Type: Bug
- Fix version(s):
- 1.1.0

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.