a2ui-project / a2ui-project/a2ui

We need a way to show an agent what a surface is displaying

Aperta
#646 6 commenti 0 reazioni 0 assegnatari Vedi su GitHub
P2 type: feature/enhancement
Lingua principale
TypeScript
Stelle
16.4k
Fork
1.3k
Merge medio
2g 13h
PR unite (30g)
134

Descrizione

In order for the user to query the agent about things they see (e.g. "Tell me about the one on the left"), the agent needs to be able to understand the layout and content of the surface.

The agent has no way to query this at the moment, and although we do have a way to send the current data model with every A2A message, we don't have any way to do the same with the UI tree.

One proposal might be to introduce a new A2UI message `querySurface` that allows the agent to get the current state of the surface, both the UI tree and the data model.

Guida per i contributori

Apri la guida per i contributori

Valutazione

Questa issue non è ancora stata valutata.

Ricevi le nuove issue nella tua casella

Un breve riepilogo di issue GitHub adatte ai principianti.