apache / apache/nuttx

[NXDART] Test framework architecture and bootstrap.

Open
#15,735 0 comments 0 reactions 4 assignees Claimed by @xiaoxiang781216 View on GitHub
Area: Testing Type: Enhancement
Dominant language
C
Stars
4k
Forks
1.7k
Avg merge
1d 17h
Merged PRs (30d)
237

Description

* Develop documented architecture for distributed runtime and build test farm.
* Use only generic portable solutions with no OS-specific hacks (i.e. Docker is Linux only).
* Target platforms: Linux, BSD, macOS, Windoze/WSL?.
* Use PyTest [1]. Each test should return PASS/FAIL result along with logs.
* Assume two configurable test areas: 1. build, 2. runtime. These should contain basic test, and should be easily extensible with extended, additional, and custom tests.
* Create easy to use bootstrap script for environment setup on end-user machines.
* Security: Consider that external malicious code or scripts can be injected by anyone as PR, and it will be executed "at premises" internal network. What mechanisms can and must be provided to avoid bad situations?

[1] https://docs.pytest.org/en/stable/

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.