apache / apache/hudi

Remove populateMetaFields handling in RowCustomColumnsSortPartitioner

Open
#16,587 1 comment 0 reactions 1 assignee Claimed by @ad1happy2go View on GitHub
area:ingest area:writer from-jira priority:medium type:improvement
Dominant language
Java
Stars
6.2k
Forks
2.5k
Avg merge
2d 8h
Merged PRs (30d)
111

Description

Remove the else block as sorting in row-writer mode is always used with populateMetaFields turned on as it allows easy access to hoodie metadata fields
without the need for generating them again. Disabling populateMetaFields defeats the purpose of row-writer and is generally never used. 

Disabling populating meta fields in metaSync can be used instead for easier operations.
[https://github.com/apache/hudi/blob/master/hudi-client/hudi-client-common/src/main/java/org/apache/hudi/table/BulkInsertPartitioner.java#L93] 

 

## JIRA info

- Link: https://issues.apache.org/jira/browse/HUDI-8101
- Type: Improvement
- Fix version(s):
- 1.1.0

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.