apache / apache/hudi

Make sample write work at client level

Open
#15,932 1 comment 0 reactions 0 assignees View on GitHub
from-jira priority:high type:improvement
Dominant language
Java
Stars
6.2k
Forks
2.5k
Avg merge
2d 8h
Merged PRs (30d)
111

Description

In HUDI-5315, deltastreamer support for sample write was added. This ticket is about extend ingthe scope to spark/flink engine write clients. There are more refactoring work regarding keeping client creation in a single place with records as input arg

## JIRA info

- Link: https://issues.apache.org/jira/browse/HUDI-6169
- Type: Improvement

Contributor guide

No contributing guide indexed for this repository

Research direction

Start by reading HUDI-5315 and tracing the Spark and Flink engine write clients to understand the existing Deltastreamer sample-write support. The work is complete when sample writes are supported at the client level for those engines and the requested client-creation refactoring is addressed.

Written by the indexing model from the issue text.

Assessment

Tech stack
java, spark
Domain
data-engineering, distributed-systems
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Active
Clarity
Mostly clear
Newbie friendliness
45/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.