apache / apache/hudi

Get rid of logic not needed by spark3.3+

Open
#16,583 1 comment 0 reactions 1 assignee Assigned to @yihua View on GitHub
area:code-quality from-jira priority:blocker type:devtask
Dominant language
Java
Stars
6.2k
Forks
2.5k
Avg merge
2d 8h
Merged PRs (30d)
111

Description

such as getDateFormatter is no longer needed

hudi-spark-datasource/hudi-spark3-common/src/main/java/org/apache/hudi/spark3/internal/ReflectUtil.java

 

 

spark adapter can probably also be reduced a lot

 

make sure to look at HUDI-7915 which adds spark4 support. Make sure not to get rid of things that we will need to add back for spark 4

## JIRA info

- Link: https://issues.apache.org/jira/browse/HUDI-8086
- Type: Task
- Fix version(s):
- 1.1.0

---

## Comments

30/Sep/24 20:57;yihua;Let's take the work of revisiting and removing APIs in SparkAdapter in a follow-up task since Spark 4 integration might need them.;;;

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.