Fix flaky test: ITTestHoodieDataSource.testWriteAndReadWithDataSkipping
- Dominant language
- Java
- Stars
- 6.2k
- Forks
- 2.5k
- Avg merge
- 2d 8h
- Merged PRs (30d)
- 111
Description
Error: ITTestHoodieDataSource.testWriteAndReadWithDataSkipping:1603
[6454|https://github.com/apache/hudi/actions/runs/7762799770/job/21173863141?pr=10512#step:6:6455]Expected: is "[+I[id1, Danny, 23, 1970-01-01T00:00:01, par1], +I[id2, Stephen, 33, 1970-01-01T00:00:02, par1], +I[id3, Julian, 53, 1970-01-01T00:00:03, par2], +I[id4, Fabian, 31, 1970-01-01T00:00:04, par2], +I[id5, Sophia, 18, 1970-01-01T00:00:05, par3], +I[id6, Emma, 20, 1970-01-01T00:00:06, par3], +I[id7, Bob, 44, 1970-01-01T00:00:07, par4], +I[id8, Han, 56, 1970-01-01T00:00:08, par4]]"
[6455|https://github.com/apache/hudi/actions/runs/7762799770/job/21173863141?pr=10512#step:6:6456] but: was "[]"
[6456|https://github.com/apache/hudi/actions/runs/7762799770/job/21173863141?pr=10512#step:6:6457]Error: ITTestHoodieDataSource.testWriteAndReadWithDataSkipping:1603
[6457|https://github.com/apache/hudi/actions/runs/7762799770/job/21173863141?pr=10512#step:6:6458]Expected: is "[+I[id1, Danny, 23, 1970-01-01T00:00:01, par1], +I[id2, Stephen, 33, 1970-01-01T00:00:02, par1], +I[id3, Julian, 53, 1970-01-01T00:00:03, par2], +I[id4, Fabian, 31, 1970-01-01T00:00:04, par2], +I[id5, Sophia, 18, 1970-01-01T00:00:05, par3], +I[id6, Emma, 20, 1970-01-01T00:00:06, par3], +I[id7, Bob, 44, 1970-01-01T00:00:07, par4], +I[id8, Han, 56, 1970-01-01T00:00:08, par4]]"
[6458|https://github.com/apache/hudi/actions/runs/7762799770/job/21173863141?pr=10512#step:6:6459] but: was "[]"
https://github.com/apache/hudi/actions/runs/7764079844/job/21177035632?pr=10512
## JIRA info
- Link: https://issues.apache.org/jira/browse/HUDI-7377
- Type: Sub-task
- Parent: https://issues.apache.org/jira/browse/HUDI-4302
Contributor guide
No contributing guide indexed for this repository
Research direction
Start with the ITTestHoodieDataSource.testWriteAndReadWithDataSkipping test at line 1603 and reproduce the failure from the linked GitHub Actions run. Compare the expected eight records with the empty result and verify the test passes consistently with the expected data-skipping behavior.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- java
- Domain
- data-engineering, testing
- Issue type
- Bug
- Difficulty
- 3/5
- Estimated time
- 1-2 days
- Activity status
- Active
- Clarity
- Mostly clear
- Newbie friendliness
- 65/100