apache / apache/hudi

Support partial update in Spark Structured Streaming

Open
#16,610 1 comment 0 reactions 1 assignee Assigned to @yihua View on GitHub
from-jira priority:blocker type:feature
Dominant language
Java
Stars
6.2k
Forks
2.5k
Avg merge
2d 8h
Merged PRs (30d)
111

Description

The partial update feature (added in https://github.com/apache/hudi/pull/9876) with the partial schema as the write config ("hoodie.write.partial.update.schema") should already work in Spark. We need to make sure that Spark Structured Streaming job can work with the new partial update feature.

## JIRA info

- Link: https://issues.apache.org/jira/browse/HUDI-8193
- Type: New Feature
- Fix version(s):
- 1.1.0

---

## Comments

15/Oct/24 03:33;yihua;Deferring this to Hudi 1.1.;;;

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.