Draft Statement of Work - Test reliability lead

The test flakiness lead will be expected to:

• lead a test reliability strategic initiative, rallying and supporting contributors who work to reduce flaky tests. This might include running regular test team meetings, documentation, tools, or whatever strategy works to achieve more than they can do on their own
• build tools and improve automation that allows the project to effectively manage flaky tests to reduce their impact on the CI
• Investigate and fix existing tests being marked as flaky in the status files

Duration

• 6 months

Success looks like

• maintain good test coverage
• reduced number of tests marked as flaky in the status files
• Running node-test-commit on the main branch will pass more often (hopefully always).
• critical mass of contributors/collaborators dedicating time to addressing flaky tests that persists beyond the strategic initiative