AbsaOSS/spark-data-standardization

A library for Spark that helps to standardize any input data (DataFrame) to adhere to the provided schema.

Stars: 7
Forks: 2
Open beginner issues: 0
Indexed issues: 7
Avg merge: 1d 18h
Merged PRs (30d): 4

Dominant language: Scala
License: Apache-2.0
Last GitHub push: Sep 9, 2026
Latest indexed: Sep 13, 2026
Contributing guide: No contributing guide
Code of conduct: No code of conduct
Beginner labels: No beginner labels indexed

Open All

7 open issues indexed

If Timestamp/Date pattern contains both literal or variable length entry and fractions of second placeholders it's likely to cause error Open

AbsaOSS/spark-data-standardization#7 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 13, 2026
Special submodules for different Spark versions Open

AbsaOSS/spark-data-standardization#12 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 13, 2026
Standardization can fail with `Task not serializable` when casting to date is requested Open

bug

AbsaOSS/spark-data-standardization#57 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 13, 2026
Incorporate `ErrorHandler` from Spark-commons. Open

AbsaOSS/spark-data-standardization#60 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 13, 2026
Validation of timestamp with ISO8601 pattern with microseconds fails Open

bug

AbsaOSS/spark-data-standardization#68 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 13, 2026
Add support for capitalized month names when casting dates Open

enhancement

AbsaOSS/spark-data-standardization#83 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 13, 2026
Standardization fails if default value is not defined for a non-nullable array Open

bug

AbsaOSS/spark-data-standardization#86 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 13, 2026

A short digest of beginner-friendly GitHub issues.