apache / apache/hudi

Redesign CDC workload to include partition column for partition pruning

Open
#16,183 0 comments 0 reactions 1 assignee Assigned to @danny0405 View on GitHub
from-jira priority:high type:improvement
Dominant language
Java
Stars
6.2k
Forks
2.5k
Avg merge
2d 8h
Merged PRs (30d)
111

Description

Currently our cdc columns have all the columns nested under before and after. Redesign schema to pull up partition column outside to support partition pruning on read side.

 

Github issue - [https://github.com/apache/hudi/issues/9426]

## JIRA info

- Link: https://issues.apache.org/jira/browse/HUDI-6713
- Type: Improvement
- Epic: https://issues.apache.org/jira/browse/HUDI-6242
- Fix version(s):
- 1.1.0

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.