apache / apache/hudi

Simplify compatibility of HoodieRecord conversion

Open
#16,210 2 comments 0 reactions 1 assignee Assigned to @linliu-code View on GitHub
from-jira priority:critical type:devtask
Dominant language
Java
Stars
6.2k
Forks
2.5k
Avg merge
2d 8h
Merged PRs (30d)
111

Description

HoodieRecordCompatibilityInterface provides adaption among any representation type (Avro, Row, etc.). We should guarantee one type end-to-end: Avro, Row for Spark (RowData for Flink). We should revisit the implementation and how config works to achieve user-friendly usability.

For Avro log block, we need conversion from Avro to Row for Spark end-to-end row writing.

## JIRA info

- Link: https://issues.apache.org/jira/browse/HUDI-6767
- Type: Task
- Epic: https://issues.apache.org/jira/browse/HUDI-3217
- Fix version(s):
- 1.1.0

---

## Comments

08/Sep/23 19:07;linliu;[~guoyihua], could you explain what the gaps are? Can Avro log block be handled in a separate task or subtasks?;;;

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.