a2ui-project / a2ui-project/a2ui

We need a way to show an agent what a surface is displaying

未关闭
#646 6 条评论 0 个 reaction 已指派 0 人 在 GitHub 查看
P2 type: feature/enhancement
主要语言
TypeScript
星标
16.4k
派生
1.3k
平均合并
2 天 13 小时
30 天内合并 PR
134

描述

In order for the user to query the agent about things they see (e.g. "Tell me about the one on the left"), the agent needs to be able to understand the layout and content of the surface.

The agent has no way to query this at the moment, and although we do have a way to send the current data model with every A2A message, we don't have any way to do the same with the UI tree.

One proposal might be to introduce a new A2UI message `querySurface` that allows the agent to get the current state of the surface, both the UI tree and the data model.

贡献指南

打开贡献指南

调研方向

The issue proposes a new A2UI message type `querySurface`. Start by examining the A2A and A2UI message handling code to understand the protocol. Look for existing message definitions and how the data model is sent. Determine where the UI tree is constructed and serialized. Implementing this requires understanding the surface state management and how to expose it via a new message.

由索引模型根据 Issue 内容生成。

评估

技术栈
typescript
领域
api, frontend
Issue 类型
功能
难度
4/5
预计耗时
3-5 天
活跃度
冷清
描述清晰度
基本清楚
新手友好度
45/100

把新 issue 发到你的邮箱

精选适合新手参与的 GitHub issue 摘要。