Add more tests to TestCOWDataSource for TimestampbasedKeyGen
- Dominant language
- Java
- Stars
- 6.2k
- Forks
- 2.5k
- Avg merge
- 2d 8h
- Merged PRs (30d)
- 111
Description
[https://github.com/apache/hudi/pull/2431] adds support to leverage spark.sql partitionBy() clause to set Hudi's partition. So, some minimal tests are added to TestCOWDataSource for timestamp based key gen. But we would like to get more coverage wrt timestamp based key gen
## JIRA info
- Link: https://issues.apache.org/jira/browse/HUDI-1610
- Type: Test
- Epic: https://issues.apache.org/jira/browse/HUDI-3303
Contributor guide
No contributing guide indexed for this repository
Research direction
Start with TestCOWDataSource and review the timestamp-based key-generation coverage added by PR #2431, including the Spark partitionBy() path. Add focused tests for the remaining timestamp-based key-generation cases and verify them with the existing TestCOWDataSource test suite.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- java, spark
- Domain
- data-engineering, testing-qa
- Issue type
- Feature
- Difficulty
- 3/5
- Estimated time
- 1-2 days
- Activity status
- Active
- Clarity
- Mostly clear
- Newbie friendliness
- 58/100