apache / apache/hudi

Persist record merging implementation classes to table config

Open
#17,299 1 comment 0 reactions 1 assignee Assigned to @yihua View on GitHub
from-jira priority:critical status:needs-attention type:devtask
Dominant language
Java
Stars
6.2k
Forks
2.5k
Avg merge
2d 8h
Merged PRs (30d)
111

Description

For CUSTOM merge mode, the list of record merging implementation classes is required for the record merging to work.  Persisting it to the table config makes it easier for query engines to know which one to use, without passing additional config.

## JIRA info

- Link: https://issues.apache.org/jira/browse/HUDI-8429
- Type: Sub-task
- Parent: https://issues.apache.org/jira/browse/HUDI-9108
- Fix version(s):
- 1.1.0

---

## Comments

05/Dec/24 11:47;vinoth;Why do we need this. Can't we discover this from the merge strategy uuid;;;

---

05/Dec/24 18:42;yihua;User still needs to "register" the custom merger implementation added by the user so the Hudi knows which merger classes to look up based on the merge strategy UUID.  The problem to be solved here is for the user to be able to query the table without providing an extra config of merge implementation class (which should be added in the table config), by simply adding the jar containing the merger implementation class.;;;

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.