apache / apache/hudi

Create ListBasedEngineContext to extract common logic for Flink and Java engines

Open
#14,896 0 comments 0 reactions 0 assignees View on GitHub
from-jira priority:high type:improvement
Dominant language
Java
Stars
6.2k
Forks
2.5k
Avg merge
2d 8h
Merged PRs (30d)
111

Description

[https://github.com/apache/hudi/pull/3778/files#r731867795]

"I see lot similarities between flink engine context and java engine context. Did you think about adding ListBasedEngineContext and make Flink and Java engine contexts inherit from it. so that we can reuse most of the code."

## JIRA info

- Link: https://issues.apache.org/jira/browse/HUDI-2626
- Type: Improvement
- Epic: https://issues.apache.org/jira/browse/HUDI-5197

Contributor guide

No contributing guide indexed for this repository

Research direction

Start by reviewing the Flink engine context and Java engine context discussed in PR 3778, comparing their shared logic and inheritance points. Define the common ListBasedEngineContext only after identifying the reusable behavior; done means both contexts use it without changing their existing behavior.

Written by the indexing model from the issue text.

Assessment

Tech stack
java
Domain
data-engineering
Issue type
Refactor
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.