Fix flaky TestHoodieJavaClientOnCopyOnWriteStorage
- Dominant language
- Java
- Stars
- 6.2k
- Forks
- 2.5k
- Avg merge
- 2d 8h
- Merged PRs (30d)
- 111
Description
TestHoodieJavaClientOnCopyOnWriteStorage could nondeterministically stop the JVM to shutdown, which causes the some CI modules to timeout.
How to reproduce: run the following commands 10+ times to find it would block the terminal.
{code:java}
mvn clean -Dscala-2.12 -Dspark3.2 install -DskipTests -T 2C -am
mvn test -Punit-tests -fae -Dspark3.2 -Dscala-2.12 -pl hudi-client/hudi-java-client -e -ntp -B -V -Dgpg.skip -Djacoco.skip -Pwarn-log -Dorg.slf4j.simpleLogger.log.org.apache.maven.plugins.shade=warn -Dorg.slf4j.simpleLogger.log.org.apache.maven.plugins.dependency=warn -Dmaven.wagon.httpconnectionManager.ttlSeconds=25 -Dmaven.wagon.http.retryHandler.count=5 -Dtest=TestHoodieJavaClientOnCopyOnWriteStorage{code}
## JIRA info
- Link: https://issues.apache.org/jira/browse/HUDI-7328
- Type: Bug
- Epic: https://issues.apache.org/jira/browse/HUDI-4302
Contributor guide
No contributing guide indexed for this repository
Research direction
Start with TestHoodieJavaClientOnCopyOnWriteStorage in hudi-client/hudi-java-client and run the supplied Maven test command repeatedly, after the build command. Trace why the test can stop the JVM and leave the terminal or CI module blocked. Done means repeated runs complete reliably without JVM shutdown or module timeouts.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- java
- Domain
- testing-qa
- Issue type
- Bug
- Difficulty
- 3/5
- Estimated time
- 1-2 days
- Activity status
- Active
- Clarity
- Mostly clear
- Newbie friendliness
- 68/100