apache / apache/servicecomb-java-chassis

[BUG] - multiple order dependent flaky tests in `swagger/swagger-generator/generator-core`

未关闭
#5,017 1 条评论 0 个 reaction 已指派 0 人 在 GitHub 查看
bug
主要语言
Java
星标
1.9k
派生
814
平均合并
8 天 23 小时
30 天内合并 PR
1

描述

### Steps to Reproduce

Several tests in the `swagger/swagger-generator/generator-core` module exhibit **order-dependent (OD) flakiness**. These tests rely on shared state through `SwaggerOperations.generate(...)` and previously used `static` fields inside the test classes. These tests previously used a `static SwaggerOperations` field that was shared across all test methods in the class, and when test methods are executed in different orders, some permutations caused a later test to run after the shared `swaggerOperations` field had already been cleared.

To reproduce:

```bash
mvn edu.illinois.cs:idflakies-maven-plugin:2.0.0:detect -pl swagger/swagger-generator/generator-core -am -Ddt.randomize.rounds=30 -Ddt.detector.original_order.all_must_pass=false
```

### Expected Behavior

Mentioned tests should pass with different orders.

### Servicecomb Version

3.3.0

### Additional Context

_No response_

贡献指南

这个仓库没有索引到贡献指南

调研方向

首先运行为 swagger/swagger-generator/generator-core 提供的 idflakies Maven 命令,并检查调用 SwaggerOperations.generate(...) 的测试。跟踪共享的 swaggerOperations 状态如何在各个测试方法之间进行初始化和清除。完成的标准是上述测试在随机化的执行顺序下都能通过。

由索引模型根据 Issue 内容生成。

评估

技术栈
java
领域
testing-qa
Issue 类型
缺陷
难度
3/5
预计耗时
1-2 天
活跃度
停滞
描述清晰度
基本清楚
新手友好度
38/100

把新 issue 发到你的邮箱

精选适合新手参与的 GitHub issue 摘要。