Migrate Sedona's GeometryUDT / Geography UDT to Spark 4.2 native Geometry and Geography data type
Open
affect public APIs
API breaking change
attention needed
- Dominant language
- Java
- Stars
- 2.4k
- Forks
- 784
- Avg merge
- 1d 12h
- Merged PRs (30d)
- 58
Description
As suggested by the title, we plan to do the migration in the upcoming Sedona 2.0.0 release. This will touch multiple places in Sedona including function signatures, serialization format, function prefix. Another related issue is https://github.com/apache/sedona/issues/2397
Contributor guide
Research direction
The issue names no files or tests; start by mapping Sedona's GeometryUDT and Geography UDT usages across function signatures, serialization, and function prefixes, then read related issue #2397. Done means the affected paths use Spark 4.2 native Geometry and Geography types for the planned Sedona 2.0.0 migration.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- java, scala, spark
- Domain
- data-engineering, distributed-systems
- Issue type
- Refactor
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Quiet
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100