apache / apache/cloudstack

tests should only run when applicable for adv-sg zone in such env

未關閉
#7,155 8 則留言 0 個 reaction 已指派 0 人 在 GitHub 檢視
long-term-plan type:enhancement
主要語言
Java
星號
3.1k
分支
1.4k
平均合併
6 天 19 小時
30 天內合併 PR
32

描述

##### ISSUE TYPE

* Documentation Report
* testing/CI

##### COMPONENT NAME

~~~
marvin
~~~

##### CLOUDSTACK VERSION

~~~
4.18
~~~

##### CONFIGURATION

~~~
advanced zone with security groups.
~~~

##### OS / ENVIRONMENT

##### SUMMARY

when an advanced zone with security groups is used to test for regressions, a lot of errors occur.
an example
```
ERROR: test suite for
----------------------------------------------------------------------
Traceback (most recent call last):
File "/usr/local/lib/python3.6/site-packages/nose/suite.py", line 210, in run
self.setUp()
File "/usr/local/lib/python3.6/site-packages/nose/suite.py", line 293, in setUp
self.setupContext(ancestor)
File "/usr/local/lib/python3.6/site-packages/nose/suite.py", line 316, in setupContext
try_run(context, names)
File "/usr/local/lib/python3.6/site-packages/nose/util.py", line 471, in try_run
return func()
File "/marvin/tests/smoke/test_router_dns.py", line 92, in setUpClass
zoneid=cls.zone.id)
File "/usr/local/lib/python3.6/site-packages/marvin/lib/base.py", line 3562, in create
return Network(apiclient.createNetwork(cmd).__dict__)
File "/usr/local/lib/python3.6/site-packages/marvin/cloudstackAPI/cloudstackAPIClient.py", line 2981, in createNetwork
response = self.connection.marvinRequest(command, response_type=response, method=method)
File "/usr/local/lib/python3.6/site-packages/marvin/cloudstackConnection.py", line 381, in marvinRequest
raise e
File "/usr/local/lib/python3.6/site-packages/marvin/cloudstackConnection.py", line 376, in marvinRequest
raise self.__lastError
File "/usr/local/lib/python3.6/site-packages/marvin/cloudstackConnection.py", line 310, in __parseAndGetResponse
response_cls)
File "/usr/local/lib/python3.6/site-packages/marvin/jsonHelper.py", line 155, in getResultObj
raise cloudstackException.CloudstackAPIException(respname, errMsg)
marvin.cloudstackException.CloudstackAPIException: Execute cmd: createnetwork failed, due to: errorCode: 431, errorText:Only shared guest network can be created in security group enabled zone
```

this is not necessary as we know beforehand that these tests will fail.
Tests need to be properly tagged to not run in these environments.

##### STEPS TO REPRODUCE

~~~

~~~

##### EXPECTED RESULTS

~~~
test will not run
~~~

##### ACTUAL RESULTS

~~~
test runs and fails
~~~

貢獻指南

開啟貢獻指南

研究方向

從 marvin/tests/smoke/test_router_dns.py 和報告中所示的 TestRouterDns 設定開始,然後檢查在具有安全性群組的進階區域中失敗的其他回歸測試。當在此環境中不適用的測試被略過,而不是執行後失敗時,即表示完成;使用受影響的測試套件驗證行為。

由索引模型根據 Issue 內容生成。

評估

技術堆疊
python
領域
testing-qa
Issue 類型
缺陷
難度
3/5
預估耗時
1-2 天
活躍度
活躍
描述清晰度
基本清楚
新手友好度
52/100

把新 issue 寄到你的電子郵件信箱

精選適合新手參與的 GitHub issue 摘要。