apache / apache/hudi

Fix constructors for all bulk insert sort partitioners to ensure we could use it as user defined partitioners

Open
#16,423 2 comments 0 reactions 0 assignees View on GitHub
area:writer from-jira priority:high type:bug
Dominant language
Java
Stars
6.2k
Forks
2.5k
Avg merge
2d 8h
Merged PRs (30d)
111

Description

Our constructor for user defined sort partitioner takes in write config, while some of the partitioners used in out of the box sort mode, does not account for it. 

 

Lets fix the sort partitioners to ensure anything can be used as user defined partitioners. 

For eg, NoneSortMode does not have a constructor that takes in write config 

## JIRA info

- Link: https://issues.apache.org/jira/browse/HUDI-7526
- Type: Bug

Contributor guide

No contributing guide indexed for this repository

Research direction

Start by locating the bulk-insert sort partitioner constructors and inspect NoneSortMode, which the issue identifies as missing a write-config constructor. Compare the out-of-the-box sort partitioners and verify that each can be used as a user-defined partitioner with write config; add or update relevant tests to confirm this.

Written by the indexing model from the issue text.

Assessment

Tech stack
java
Domain
data-engineering
Issue type
Bug
Difficulty
3/5
Estimated time
1-2 days
Activity status
Active
Clarity
Mostly clear
Newbie friendliness
55/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.