apache / apache/hudi

Spark Record / Spark Merger gaps with Avro during writing

Open
#16,659 1 comment 0 reactions 1 assignee Claimed by @yihua View on GitHub
area:writer engine:spark from-jira priority:critical status:needs-attention type:bug
Dominant language
Java
Stars
6.2k
Forks
2.5k
Avg merge
2d 8h
Merged PRs (30d)
111

Description

Using native spark records on the write path has some missing features and divergence from using avro records on the write path. Fix all cases so we can use it by default

## JIRA info

- Link: https://issues.apache.org/jira/browse/HUDI-8317
- Type: Bug
- Epic: https://issues.apache.org/jira/browse/HUDI-6243
- Fix version(s):
- 1.1.0

---

## Comments

05/Dec/24 12:04;vinoth;Can you write down these gaps.;;;

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.