AgentOps-AI / AgentOps-AI/agentops

[Feature]: TealTiger governance event integration — surface policy decisions in AgentOps dashboard

未關閉
#1,407 1 則留言 0 個 reaction 已指派 0 人 在 GitHub 檢視
enhancement
主要語言
Python
星號
5.8k
分支
619
PR 合併指標
30 天內沒有已合併 PR

描述

### 💡 Feature Description and Proposed Solution

[TealTiger](https://github.com/agentguard-ai/tealtiger) is a deterministic governance SDK for AI agents — it evaluates tool allowlists, PII detection, secret scanning, and cost budgets before every consequential action, producing a structured decision event each time.

**Proposed integration**: Emit TealTiger governance decisions as AgentOps `ActionEvent`s so they appear in the session timeline alongside LLM traces and tool calls.

What this would look like:

```python
import agentops
from tealtiger import TealOpenAI

agentops.init(api_key="your-key")

# TealTiger decisions auto-emit to AgentOps
client = TealOpenAI(
api_key=os.environ["OPENAI_API_KEY"],
guardrails={"pii_detection": True, "secret_detection": True},
budget={"max_cost_per_session": 5.00},
)

```

Each governance decision would emit an event with:

action_type: "governance_decision"
result: allow / deny / monitor
params: {tool_name, reason_codes, risk_score, evaluation_time_ms}
This gives teams visibility into why an agent was blocked, right next to the LLM trace — without switching tools.

Why AgentOps specifically: You already track cost and LLM calls. Governance decisions are the missing dimension — they explain why something didn't happen, which is invisible in traces today.

TealTiger: https://github.com/agentguard-ai/tealtiger
PyPI: pip install tealtiger
Already integrated with AG2, CrewAI, LangChain, Vercel AI SDK

### 🤔 Related Problem

**🤔 Related Problem:**

When agents are governed (tool calls blocked, budget exceeded, PII detected), there's no visibility into those denials in the observability dashboard. The session timeline shows a gap — the tool call just... doesn't happen — with no explanation of why. Teams end up correlating separate governance logs manually.

### 🤝 Contribution

- [x] Yes, I'd be happy to submit a pull request with these changes.
- [ ] I need some guidance on how to contribute.
- [ ] I'd prefer the AgentOps team to handle this update.

貢獻指南

開啟貢獻指南

評估

這個 Issue 還沒有評估資料。

把新 issue 寄到你的電子郵件信箱

精選適合新手參與的 GitHub issue 摘要。