AgentOps-AI / AgentOps-AI/agentops

[Feature] WFGY problem codes as tags in AgentOps traces for multi-agent debugging

Aberta
#1,281 4 comentários 0 reações 0 responsáveis Ver no GitHub
Linguagem predominante
Python
Estrelas
5.8k
Forks
619
Métricas de merge de PRs
Nenhum PR com merge em 30d

Descrição

Hi, thanks for AgentOps and the MCP server. This kind of observability is essential when debugging complex agent runs.

I work on WFGY, an open semantic “firewall” and diagnostic layer for LLM pipelines, based on a 16-problem failure map for RAG and agents:

ProblemMap and docs:
https://github.com/onestardao/WFGY/blob/main/ProblemMap/README.md

The same taxonomy is now used or referenced in Harvard MIMS ToolUniverse, QCRI Multimodal RAG Survey and the Innsbruck Rankify project.

Idea

When reading traces in AgentOps, users often see a failure but have no compact vocabulary to describe it.

I propose an optional “WFGY problem tag” feature:

allow users to tag a trace or span with one or more WFGY problem codes (No.1–No.16),

surface these tags in the UI and export,

optionally include a link to the relevant ProblemMap doc for each tag.

This keeps AgentOps neutral, but gives teams a shared language for what went wrong.

If this aligns with your roadmap, I can help provide the mapping text and short descriptions for each problem.

Guia de contribuição

Abrir o guia de contribuição

Avaliação

Esta issue ainda não foi avaliada.

Receba novas issues na sua caixa de entrada

Um resumo curto de issues do GitHub para quem está começando.