apache / apache/hudi

Improve DeltaStreamet test setup including data prep logic

Open
#15,084 0 comments 0 reactions 0 assignees View on GitHub
area:tests from-jira priority:high
Dominant language
Java
Stars
6.2k
Forks
2.5k
Avg merge
2d 8h
Merged PRs (30d)
111

Description

The data prep logic in deltastreamer test cases are chaotic, shared static vars, resource files unorganized . We should revamp deltastreamer tests at some point soon.

 

Also, fix issues related to proper shutdown of services started during setup.

## JIRA info

- Link: https://issues.apache.org/jira/browse/HUDI-3704
- Type: Test
- Epic: https://issues.apache.org/jira/browse/HUDI-3303

Contributor guide

No contributing guide indexed for this repository

Research direction

Start by locating the DeltaStreamer test cases and reviewing their data-preparation logic, shared static variables, and resource-file layout. Then inspect how services started during setup are shut down. Done means the test setup is organized, data preparation is no longer chaotic or improperly shared, resources are structured, and setup services shut down correctly.

Written by the indexing model from the issue text.

Assessment

Tech stack
java
Domain
stream-processing, testing
Issue type
Refactor
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.