elastic / elastic/elastic-agent

Add an AI review workflow focused on integration test correctness

Open
#14,958 2 comments 2 reactions 0 assignees View on GitHub
chore flaky-test Team:Elastic-Agent-Control-Plane
Dominant language
Go
Stars
275
Forks
264
Avg merge
1d 23h
Merged PRs (30d)
312

Description

In integration tests we add or modify, we tend to make the same conceptual mistakes later leading to flakiness:

- not using the test's individual namespace
- invalid testify assertions in Eventually blocks which can only succeed the first time
- not waiting for necessary conditions properly.
- ...

We should produce a proper list with instructions, then have an agentic workflow run on any PR modifying integration tests, looking for these specific mistakes. This should be relatively cheap, as it only runs on diffs, and shouldn't hallucinate too much given the narrow scope.

Contributor guide

Open the contributing guide

Research direction

No files or existing workflow entry points are named. Start by locating the integration-test changes and the PR workflow configuration, then define the promised checklist around individual namespaces, Eventually assertions, and waiting conditions. Done means a focused workflow reviews only relevant diffs and reports these mistakes using agreed instructions.

Written by the indexing model from the issue text.

Assessment

Tech stack
go
Domain
ai, ci-cd, testing
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Quiet
Clarity
Mostly clear
Newbie friendliness
45/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.