Improve TestCOWDataSource and TestMORDataSource
Open
from-jira
priority:high
type:improvement
- Dominant language
- Java
- Stars
- 6.2k
- Forks
- 2.5k
- Avg merge
- 2d 8h
- Merged PRs (30d)
- 111
Description
Areas to focus on:
(1) globbed vs non-globbed paths for readers
(2) stricter validation on data fields than matching count
## JIRA info
- Link: https://issues.apache.org/jira/browse/HUDI-5397
- Type: Improvement
Contributor guide
No contributing guide indexed for this repository
Research direction
Start by locating TestCOWDataSource and TestMORDataSource in the repository and read their existing reader and data-field tests. Compare coverage for globbed and non-globbed paths, then inspect how field validation currently checks matching counts. Done means both path forms are covered and data fields are validated more strictly than count matching.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- java
- Domain
- data-engineering, testing
- Issue type
- Refactor
- Difficulty
- 3/5
- Estimated time
- 1-2 days
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 35/100