Add smoke tests to read tables that were written by Flink
- Dominant language
- Java
- Stars
- 6.2k
- Forks
- 2.5k
- Avg merge
- 2d 8h
- Merged PRs (30d)
- 111
Description
As of now, test tables are generated with Spark + Hudi, and we should also be testing on tables that are created with Flink.
Flink supports Timestamp with different precision, HudiAvroSerializer definitely does not support these now.
Add tests to cover such blindspots for now.
## JIRA info
- Link: https://issues.apache.org/jira/browse/HUDI-9430
- Type: Task
- Epic: https://issues.apache.org/jira/browse/HUDI-2687
Contributor guide
No contributing guide indexed for this repository
Research direction
Start with the existing smoke tests for tables generated with Spark + Hudi and inspect HudiAvroSerializer handling of timestamp precision. Add coverage for tables written by Flink, including its different timestamp precisions, and verify the tests expose the currently unsupported cases.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- java, spark
- Domain
- data-engineering, testing
- Issue type
- Feature
- Difficulty
- 3/5
- Estimated time
- 1-2 days
- Activity status
- Active
- Clarity
- Mostly clear
- Newbie friendliness
- 55/100