AbsaOSS / AbsaOSS/enceladus

Add support for Avro format in Standardization

Open
#1,165 0 comments 0 reactions 0 assignees View on GitHub
feature priority: undecided Standardization under discussion
Dominant language
Scala
Stars
33
Forks
16
PR merge metrics
No merged PRs in 30d

Description

## Background
The rationale for the issue is the same as in #1126

## Feature
Add support for reading raw files in Avro format in Standardization.

## Additional context
- Should full standardization be performed on Avro files or we may treat Avfo files similar to parquet and do not do the casting of all fields?
- (Question from @GeorgiChochov). Does the handling of Avro data (both batch and streaming) need special handling of timestamp and date fields?

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.