tests should only run when applicable for adv-sg zone in such env
- 主要語言
- Java
- 星號
- 3.1k
- 分支
- 1.4k
- 平均合併
- 6 天 19 小時
- 30 天內合併 PR
- 32
描述
##### ISSUE TYPE
* Documentation Report
* testing/CI
##### COMPONENT NAME
~~~
marvin
~~~
##### CLOUDSTACK VERSION
~~~
4.18
~~~
##### CONFIGURATION
~~~
advanced zone with security groups.
~~~
##### OS / ENVIRONMENT
##### SUMMARY
when an advanced zone with security groups is used to test for regressions, a lot of errors occur.
an example
```
ERROR: test suite for
----------------------------------------------------------------------
Traceback (most recent call last):
File "/usr/local/lib/python3.6/site-packages/nose/suite.py", line 210, in run
self.setUp()
File "/usr/local/lib/python3.6/site-packages/nose/suite.py", line 293, in setUp
self.setupContext(ancestor)
File "/usr/local/lib/python3.6/site-packages/nose/suite.py", line 316, in setupContext
try_run(context, names)
File "/usr/local/lib/python3.6/site-packages/nose/util.py", line 471, in try_run
return func()
File "/marvin/tests/smoke/test_router_dns.py", line 92, in setUpClass
zoneid=cls.zone.id)
File "/usr/local/lib/python3.6/site-packages/marvin/lib/base.py", line 3562, in create
return Network(apiclient.createNetwork(cmd).__dict__)
File "/usr/local/lib/python3.6/site-packages/marvin/cloudstackAPI/cloudstackAPIClient.py", line 2981, in createNetwork
response = self.connection.marvinRequest(command, response_type=response, method=method)
File "/usr/local/lib/python3.6/site-packages/marvin/cloudstackConnection.py", line 381, in marvinRequest
raise e
File "/usr/local/lib/python3.6/site-packages/marvin/cloudstackConnection.py", line 376, in marvinRequest
raise self.__lastError
File "/usr/local/lib/python3.6/site-packages/marvin/cloudstackConnection.py", line 310, in __parseAndGetResponse
response_cls)
File "/usr/local/lib/python3.6/site-packages/marvin/jsonHelper.py", line 155, in getResultObj
raise cloudstackException.CloudstackAPIException(respname, errMsg)
marvin.cloudstackException.CloudstackAPIException: Execute cmd: createnetwork failed, due to: errorCode: 431, errorText:Only shared guest network can be created in security group enabled zone
```
this is not necessary as we know beforehand that these tests will fail.
Tests need to be properly tagged to not run in these environments.
##### STEPS TO REPRODUCE
~~~
~~~
##### EXPECTED RESULTS
~~~
test will not run
~~~
##### ACTUAL RESULTS
~~~
test runs and fails
~~~
貢獻指南
研究方向
從 marvin/tests/smoke/test_router_dns.py 和報告中所示的 TestRouterDns 設定開始,然後檢查在具有安全性群組的進階區域中失敗的其他回歸測試。當在此環境中不適用的測試被略過,而不是執行後失敗時,即表示完成;使用受影響的測試套件驗證行為。
由索引模型根據 Issue 內容生成。
評估
- 技術堆疊
- python
- 領域
- testing-qa
- Issue 類型
- 缺陷
- 難度
- 3/5
- 預估耗時
- 1-2 天
- 活躍度
- 活躍
- 描述清晰度
- 基本清楚
- 新手友好度
- 52/100