matrix-org / matrix-org/trafficlight

Randomize (?) or otherwise improve the order of TestCases such that all cases are picked for action over time.

Open
#15 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
7
Forks
1
PR merge metrics
No merged PRs in 30d

Description

Randomization gets us so far. Better still might be to know historical test cases that have been executed and attempt to "fill in the gaps" first, before we run all possible tests.

Contributor guide

Open the contributing guide

Research direction

No files, tests, or entry points are named. Start by locating the TestCase selection and execution flow, then determine whether execution history is stored; the issue needs a defined selection policy and completion criteria before implementation can be scoped.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
testing-qa
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.