Revisit Disabled ITTestHoodieDataSource
- Dominant language
- Java
- Stars
- 6.2k
- Forks
- 2.5k
- Avg merge
- 2d 8h
- Merged PRs (30d)
- 111
Description
Within the pr (Support Hadoop 3.x Hive 3.x and Spark 3.x) [https://github.com/apache/hudi/pull/5786,|https://github.com/apache/hudi/pull/5786]
the upgrade to hadoop 3.x has caused flakiness with this test class
ITTestHoodieDataSource, and has lead to the azure ci timing out due to issues with hanging on tests.
## JIRA info
- Link: https://issues.apache.org/jira/browse/HUDI-4234
- Type: Task
Contributor guide
No contributing guide indexed for this repository
Research direction
Start by reviewing the ITTestHoodieDataSource test class and the changes in pull request #5786, then investigate the Azure CI timeout and hanging tests under Hadoop 3.x. Done means the integration test is no longer flaky or disabled and the relevant CI run completes successfully.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- hadoop, java, spark
- Domain
- data-engineering, testing
- Issue type
- Bug
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Quiet
- Clarity
- Mostly clear
- Newbie friendliness
- 45/100