apache / apache/hudi

Refactor WriteMarkersFactory get API

Open
#16,088 0 comments 0 reactions 0 assignees View on GitHub
from-jira priority:medium type:bug
Dominant language
Java
Stars
6.2k
Forks
2.5k
Avg merge
2d 8h
Merged PRs (30d)
111

Description

Refactor public static WriteMarkers get(MarkerType markerType, HoodieTable table, String instantTime) to
public static WriteMarkers get(MarkerType markerType, HoodieTableMetaClient tableMetaClient, String instantTime).

When starting a commit with direct markers, for populating the marker folder .hoodie/.temp/, we need access to the HoodieTable, with the current API. Changing this to a HoodieTableMetaClient would simplify the API.
cc: [~danny0405] [~sivabalan]

## JIRA info

- Link: https://issues.apache.org/jira/browse/HUDI-6518
- Type: Bug

Contributor guide

No contributing guide indexed for this repository

Research direction

Start with WriteMarkersFactory and its public static get(MarkerType, HoodieTable, String) method, then trace callers involved in starting commits with direct markers. Update the API and its callers to use HoodieTableMetaClient, and verify that marker-folder population still works for the .hoodie/.temp/ path.

Written by the indexing model from the issue text.

Assessment

Tech stack
java
Domain
data-engineering
Issue type
Refactor
Difficulty
3/5
Estimated time
1-2 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
48/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.