CC test authors / triage owners on Phabricator patches that disable a test
Nobody has claimed this yet.
- Dominant language
- Python
- Stars
- 68
- Forks
- 92
- Avg merge
- 2d 2h
- Merged PRs (30d)
- 16
Description
If a test fails too frequently and sheriffs did not have any luck getting traction to fix it, they will simply skip it. We try to let the triage-owner of a component know via needinfo, but this is:
- Inconsistent
- Not actually a needinfo (just an fyi)
- Usually results in no action
- Probably annoying to triage-owners of large components with lots of tests
It would be nice if we could simply CC the test author (if we can find them) and the triage owner (because why not) right on the patch in Phabricator. At this point, they have already been warned that the test will be disabled (see also issue #1126), so they should be CC'ed rather than requested for review.
We'll need to determine which patches qualify as "disabling a test". Some basic criteria might be:
- Submitted by a sheriff
- Only touches a test manifest (list of test manifests can be extracted from
moz.buildmetadata)
Some text processing would also likely be needed to determine which test in the manifest is being modified.
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start by tracing bugbot's Phabricator patch handling and the moz.build metadata used to identify test manifests; issue #1126 provides related context. Determine how to recognize patches that disable a test, find the affected test and its author, and CC that author and the component triage owner without requesting review.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- release, testing-qa, tooling
- Issue type
- Feature
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 35/100