AgentOps-AI / AgentOps-AI/agentops

[Feature] WFGY problem codes as tags in AgentOps traces for multi-agent debugging

未關閉
#1,281 4 則留言 0 個 reaction 已指派 0 人 在 GitHub 檢視
主要語言
Python
星號
5.8k
分支
619
PR 合併指標
30 天內沒有已合併 PR

描述

Hi, thanks for AgentOps and the MCP server. This kind of observability is essential when debugging complex agent runs.

I work on WFGY, an open semantic “firewall” and diagnostic layer for LLM pipelines, based on a 16-problem failure map for RAG and agents:

ProblemMap and docs:
https://github.com/onestardao/WFGY/blob/main/ProblemMap/README.md

The same taxonomy is now used or referenced in Harvard MIMS ToolUniverse, QCRI Multimodal RAG Survey and the Innsbruck Rankify project.

Idea

When reading traces in AgentOps, users often see a failure but have no compact vocabulary to describe it.

I propose an optional “WFGY problem tag” feature:

allow users to tag a trace or span with one or more WFGY problem codes (No.1–No.16),

surface these tags in the UI and export,

optionally include a link to the relevant ProblemMap doc for each tag.

This keeps AgentOps neutral, but gives teams a shared language for what went wrong.

If this aligns with your roadmap, I can help provide the mapping text and short descriptions for each problem.

貢獻指南

開啟貢獻指南

評估

這個 Issue 還沒有評估資料。

把新 issue 寄到你的電子郵件信箱

精選適合新手參與的 GitHub issue 摘要。