[CI] Performance downgrades dramatically for full tests after using pytest
Open
act-platform-engineering-squad
CI
feature-request
performance
Test Framework
- Dominant language
- Python
- Stars
- 4.6k
- Forks
- 3.5k
- Avg merge
- 3d 2h
- Merged PRs (30d)
- 60
Description
Description:
Performance downgrades dramatically for full tests (nearly 2000 tests) after using pytest.
Using nose, the time cost is about 60 mins.
Using pytest, the time cost is about 110 mins.
Suggest action:
- add performance telemetry for each test for both nose and pytest.
- collect performance data.
- compare performance data to find root cause.
- Fix the root cause.
Contributor guide
Assessment
This issue has not been assessed yet.