apache / apache/hudi

Refactor SparkHoodieBackedTableMetadataWriter.getFunctionalIndexRecords to abstract it out

Open
#17,294 1 comment 0 reactions 1 assignee Assigned to @nsivabalan View on GitHub
area:code-quality area:metadata-table from-jira priority:critical type:devtask
Dominant language
Java
Stars
6.2k
Forks
2.5k
Avg merge
2d 8h
Merged PRs (30d)
111

Description

Refactor SparkHoodieBackedTableMetadataWriter.getFunctionalIndexRecords to abstract it out so that other engines can leverage. the engine specific transformation can be overriden in spark, but rest of the logic should be moved to HoodieBackedTableMetadatWriter. 

 

Refer to [https://github.com/apache/hudi/pull/12127#discussion_r1807469757] for more info 

## JIRA info

- Link: https://issues.apache.org/jira/browse/HUDI-8397
- Type: Sub-task
- Parent: https://issues.apache.org/jira/browse/HUDI-9096
- Fix version(s):
- 1.1.0

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.