Support SCD2 types in Hudi tables
- Dominant language
- Java
- Stars
- 6.2k
- Forks
- 2.5k
- Avg merge
- 2d 4h
- Merged PRs (30d)
- 112
Description
https://github.com/apache/hudi/issues/2284
## JIRA info
- Link: https://issues.apache.org/jira/browse/HUDI-1973
- Type: Improvement
---
## Comments
16/Dec/22 12:25;pushpavanthar;Hi,
Is there any plan to support this feature in future? It'll be very helpful if Hudi supports SCD type-2 feature out of the box. I've come across lot of people looking for this feaure.;;;
Contributor guide
No contributing guide indexed for this repository
Research direction
Start by reading the linked GitHub issue #2284 and JIRA ticket HUDI-1973 to understand the requested SCD type-2 behavior and prior discussion. Identify the relevant Hudi table and processing entry points from that material, then establish acceptance criteria showing that SCD2 is supported out of the box.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- java
- Domain
- data-engineering
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100