apache / apache/hudi

Allow option to override schema when doing spark.write

Open
#14,711 0 comments 0 reactions 1 assignee Claimed by @ad1happy2go View on GitHub
engine:spark from-jira priority:high type:community-support type:feature
Dominant language
Java
Stars
6.2k
Forks
2.5k
Avg merge
2d 8h
Merged PRs (30d)
111

Description

Need ability to pass schema and use it to create RDD when creating input batch from data-frame. 

 

df.write.format("hudi").option("hudi.avro.schema", "")......

## JIRA info

- Link: https://issues.apache.org/jira/browse/HUDI-1440
- Type: New Feature
- Affects version(s):
- 0.9.0

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.