dotnet / dotnet/arcade-services

AI-assisted regex generator for Build Insights (automation of known issue reporting)

Open
#6,012 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
C#
Stars
86
Forks
86
Avg merge
1d 8h
Merged PRs (30d)
35

Description

## Epic: AI-assisted Regex Generator Integration in Build Insights

This Epic aims to develop an AI-assisted regex generator feature in Build Insights (previously Build Analysis) for dotnet/arcade-services. This tool will greatly improve the process of reporting new known issues by automating regex formulation, validation, and integration. The process will leverage the workflow and documentation outlined at [KnownIssues.md](https://github.com/dotnet/arcade/blob/main/Documentation/Projects/Build%20Analysis/KnownIssues.md).

### Feature Overview

- **User Flow:**
1. A user identifies and describes an issue requiring reporting as "known".
2. The AI gathers a representative sample of log data.
3. The AI automatically generates a regex pattern to detect the issue within the logs.
4. AI validates the regex on the gathered sample to ensure accuracy.
5. After user confirmation, the system automatically registers the issue as "known", minimizing manual intervention.
6. AI creates a tracking issue in the appropriate product repo to address the root cause.
7. AI analyzes the logs/issues, proposes a solution, and, where feasible, creates a PR with a fix.

### Goals
- Streamline and automate the known issue reporting process
- Reduce manual regex crafting and validation
- Improve accuracy and speed of known issue tracking
- Enable AI-driven root cause analysis and remediation proposals

### Acceptance Criteria
- Demo of end-to-end AI-assisted workflow following the steps above
- Extensive logging and traceability for all AI actions
- Documentation updates to KnownIssues.md to reflect the new process

---
_Type: Epic_

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.