aws / aws/amazon-q-developer-cli

Feature Request: Access to agent output in lifecycle hook(s)

Open
#3,476 0 comments 3 reactions 0 assignees View on GitHub
Dominant language
Rust
Stars
2k
Forks
439
PR merge metrics
No merged PRs in 30d

Description

**Summary:**

I’m looking to implement Telemetry into custom agents (specifically DataDog LLM Observability). The basic hookup works okay with the current suite of hooks in Q/Kiro CLI.

However a good portion of the interesting functionality we would be interested in require access to the output of the agent given to the user. It can use that to evaluate things like error rates, hallucinations, etc.

Currently I don’t see any hook into the lifecycle that would provide both the agent input and output for a given request. I was thinking including both of those on the “[stop](https://github.com/aws/amazon-q-developer-cli/blob/main/docs/hooks.md#stop)” hook would be sufficient.

**Request:**

- A new, or updated existing, hook that for each request to an agent provides the input and output as part of the JSON payload for the hook.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.