Investigate test failures w/ record level index for existing tests
- Dominant language
- Java
- Stars
- 6.2k
- Forks
- 2.5k
- Avg merge
- 2d 8h
- Merged PRs (30d)
- 111
Description
Enable record level index for some of the chosen tests (30 to 40) and ensure they succeed. The parameterized tests covered in the jira are.
TestCOWDataSourceStorage, TestSparkDataSource, TestMORDataSourceStorage, TestCOWDataSource#testDropInsertDup and
TestHoodieClientOnCopyOnWriteStorage (Sub tests below for TestHoodieClientOnCopyOnWriteStorage)
Auto commit tests
testDeduplicationOnInsert
testDeduplicationOnUpsert
testInsertsWithHoodieConcatHandle
testDeletes
testUpsertsUpdatePartitionPathGlobalBloom
testSmallInsertHandlingForUpserts
testSmallInsertHandlingForInserts
testDeletesWithDeleteApi
## JIRA info
- Link: https://issues.apache.org/jira/browse/HUDI-5490
- Type: Improvement
- Epic: https://issues.apache.org/jira/browse/HUDI-466
Contributor guide
No contributing guide indexed for this repository
Research direction
Start with JIRA HUDI-5490 and locate the named parameterized tests: TestCOWDataSourceStorage, TestSparkDataSource, TestMORDataSourceStorage, TestCOWDataSource#testDropInsertDup, and the listed TestHoodieClientOnCopyOnWriteStorage subtests. Run the selected tests with record-level indexing enabled, investigate their failures, and finish when all targeted tests succeed.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- java
- Domain
- data-engineering, testing-qa
- Issue type
- Bug
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 35/100