cncf / cncf/mentoring

[CNCF LFX Proposal] Podman Container Tools: Agentic CI Flake Categorization and Analysis

Open
#1,963 18 comments 0 reactions 0 assignees View on GitHub
2026 CNCF Approved Exported lfx mentorship Maintainer/Contribex Approved Mentors Confirmed Proposal Term 3: Sept-Nov Validation Passed
Dominant language
JavaScript
Stars
3.1k
Forks
816
Avg merge
12h 32m
Merged PRs (30d)
8

Description

### CNCF Project

Podman Container Tools

### Term

2026 Term 3 (Sep-Nov)

### Program Name

Agentic CI Flake Categorization and Analysis

### Program Description

## Description
Continuous Integration (CI) pipelines are the backbone of our development, but "flaky" tests—tests that exhibit both false positive and false negative outcomes randomly—severely degrade developer velocity and erode trust in the CI system.
Currently, our project relies on GitHub Actions for its CI/CD processes. Manually digging through extensive GitHub Actions logs to identify, categorize, and troubleshoot these flaky failures is a massive, time-consuming burden for maintainers.
This internship aims to solve this by building an intelligent, automated toolchain that monitors our GitHub Actions workflows for flaky behavior and leverages an agentic AI workflow to handle the heavy lifting of analysis. The intern will build a system that automatically extracts failing logs, uses AI agents to reason about the failure (differentiating between infrastructure blips, race conditions, network timeouts, etc.), and surfaces actionable mitigation strategies directly to the maintainers.

## Expected Outcomes
Data Ingestion Pipeline: A mechanism to automatically fetch, filter, and parse flaky CI run data and logs directly from the GitHub Actions API.
Agentic Analysis Engine: An integration with an AI/LLM framework designed to read failure logs, categorize the root cause of the flake, and generate a plain-English analysis.
Mitigation & Reporting: A reporting layer that takes the agent's findings and seamlessly integrates them into the developer workflow (e.g., auto-generating GitHub Issues, compiling weekly flake reports, or posting PR comments with suggested fixes).
Documentation: Comprehensive documentation covering the architecture of the tool, how to deploy it, and how maintainers can tweak the agent's prompts and behaviors.

# Recommended Skills
Proficiency in Python or Go (for scripting and API interactions).
Familiarity with GitHub Actions, CI/CD concepts, and log analysis.
Interest or experience in Generative AI, LLMs, and agentic workflows (prompt engineering, AI tool calling).
Experience with the GitHub API is a strong plus.
Familiarity with Local AI is a plus

### Technologies

AI, CI/CD, Github Actions, Go, Python

### Skills same as Technologies?

- [x] Yes, the required skills are the same as the technologies listed above.

### Required/Desirable Skills

_No response_

### Mentors

Paul Holzinger | @Luap99 | pholzing@redhat.com | luap99
Tim Zhou | @timcoding1988 | tizhou@redhat.com | timcoding1988
Mohan Boddu | @mohanboddu | mboddu@redhat.com | bhujji

### Upstream Issue URL

https://github.com/podman-container-tools/podman/issues/29265

### Application Prerequisites

- [x] Resume
- [x] Cover Letter
- [ ] School Enrollment Verification
- [ ] Participation Permission from school or employer
- [ ] Coding Challenge
- [ ] Custom Prerequisite (fill in details below)

### Coding Challenge URL

_No response_

### Custom Prerequisite Name

_No response_

### Custom Prerequisite Description

_No response_

### Custom Prerequisite — File Upload

- [ ] Yes — completion of this task requires the mentee to submit a file.

---
**LFX program:** [CNCF - Podman Container Tools: Agentic CI Flake Categorization and Analysis (2026 Term 3)](https://mentorship.lfx.linuxfoundation.org/project/050e89d9-aec2-47ad-9113-3ba41a639d55)

Contributor guide

Open the contributing guide

Research direction

Start by reading the upstream issue #29265 and reviewing the stated GitHub Actions API, log-analysis, agentic workflow, and reporting requirements. Done means delivering an automated pipeline for flaky-run ingestion, AI-based categorization, maintainer-facing mitigation reports, and deployment and prompt-tuning documentation.

Written by the indexing model from the issue text.

Assessment

Tech stack
github-actions, go, python
Domain
ai, api, ci-cd, devops
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Quiet
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.