eclipse-jdt / eclipse-jdt/eclipse.jdt.core

TestAll.testBug543480WithSameSubSuperOptimization failed in I-build

Open
#5,406 0 comments 0 reactions 0 assignees View on GitHub
bug test
Dominant language
Java
Stars
237
Forks
195
Avg merge
1d 12h
Merged PRs (30d)
47

Description

See: https://download.eclipse.org/eclipse/downloads/drops4/I20260912-2300/testresults/html/org.eclipse.jdt.core.tests.compiler_ep442I-unit-macosx-aarch64-java26_macosx.cocoa.aarch64_26.html

```
Potential fluctuation of a performance test: minimum long compile time 1.0ms should be less than 10.0x the minimum short compile time 0.0ms long compile times: [#5 1ms (excluded), #6 1ms (excluded), #7 1ms, #8 1ms, #10 1ms, #4 2ms, #9 2ms, #3 5ms, #2 6ms (excluded), #1 13ms (excluded)] short compile times: [#8 0ms (excluded), #9 0ms (excluded), #10 0ms, #6 1ms, #7 1ms, #4 2ms, #5 2ms, #2 3ms, #3 3ms (excluded), #1 9ms (excluded)]

junit.framework.AssertionFailedError: Potential fluctuation of a performance test: minimum long compile time 1.0ms should be less than 10.0x the minimum short compile time 0.0ms
long compile times: [#5 1ms (excluded), #6 1ms (excluded), #7 1ms, #8 1ms, #10 1ms, #4 2ms, #9 2ms, #3 5ms, #2 6ms (excluded), #1 13ms (excluded)]
short compile times: [#8 0ms (excluded), #9 0ms (excluded), #10 0ms, #6 1ms, #7 1ms, #4 2ms, #5 2ms, #2 3ms, #3 3ms (excluded), #1 9ms (excluded)]
at junit.framework.Assert.fail(Assert.java:57)
at junit.framework.Assert.assertTrue(Assert.java:22)
at junit.framework.TestCase.assertTrue(TestCase.java:192)
at org.eclipse.jdt.core.tests.compiler.regression.GenericTypeTest.assertCompileTimes(GenericTypeTest.java:50254)
at org.eclipse.jdt.core.tests.compiler.regression.GenericTypeTest.testBug543480WithSameSubSuperOptimization(GenericTypeTest.java:50198)
at java.base/java.lang.reflect.Method.invoke(Method.java:565)
at junit.framework.TestCase.runTest(TestCase.java:177)
at org.eclipse.jdt.core.tests.junit.extension.TestCase.runTest(TestCase.java:970)
at junit.framework.TestCase.runBare(TestCase.java:142)
at junit.framework.TestResult$1.protect(TestResult.java:122)
at junit.framework.TestResult.runProtected(TestResult.java:142)
at junit.framework.TestResult.run(TestResult.java:125)
at junit.framework.TestCase.run(TestCase.java:130)
at junit.framework.TestSuite.runTest(TestSuite.java:241)
at junit.framework.TestSuite.run(TestSuite.java:236)
at junit.framework.TestSuite.runTest(TestSuite.java:241)
at junit.framework.TestSuite.run(TestSuite.java:236)
at org.eclipse.jdt.core.tests.util.CompilerTestSetup.run(CompilerTestSetup.java:57)
at junit.framework.TestSuite.runTest(TestSuite.java:241)
at junit.framework.TestSuite.run(TestSuite.java:236)
```

No idea what we do about such issues.

Contributor guide

Open the contributing guide

Research direction

Start by rerunning TestAll.testBug543480WithSameSubSuperOptimization in GenericTypeTest.java on the reported I-build environment and inspect the failure at assertCompileTimes. Compare the long and short compile-time samples and determine whether the failure is reproducible. Done means the test has a reliable, justified outcome without masking a genuine regression.

Written by the indexing model from the issue text.

Assessment

Tech stack
java
Domain
performance, testing-qa
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Active
Clarity
Needs clarification
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.