AgentOps-AI / AgentOps-AI/agentops

[Feature] WFGY problem codes as tags in AgentOps traces for multi-agent debugging

未关闭
#1,281 4 条评论 0 个 reaction 已指派 0 人 在 GitHub 查看
主要语言
Python
星标
5.8k
派生
619
PR 合并指标
30 天内没有已合并 PR

描述

Hi, thanks for AgentOps and the MCP server. This kind of observability is essential when debugging complex agent runs.

I work on WFGY, an open semantic “firewall” and diagnostic layer for LLM pipelines, based on a 16-problem failure map for RAG and agents:

ProblemMap and docs:
https://github.com/onestardao/WFGY/blob/main/ProblemMap/README.md

The same taxonomy is now used or referenced in Harvard MIMS ToolUniverse, QCRI Multimodal RAG Survey and the Innsbruck Rankify project.

Idea

When reading traces in AgentOps, users often see a failure but have no compact vocabulary to describe it.

I propose an optional “WFGY problem tag” feature:

allow users to tag a trace or span with one or more WFGY problem codes (No.1–No.16),

surface these tags in the UI and export,

optionally include a link to the relevant ProblemMap doc for each tag.

This keeps AgentOps neutral, but gives teams a shared language for what went wrong.

If this aligns with your roadmap, I can help provide the mapping text and short descriptions for each problem.

贡献指南

打开贡献指南

评估

这个 Issue 还没有评估数据。

把新 issue 发到你的邮箱

精选适合新手参与的 GitHub issue 摘要。