google / google/agents-cli

Evaluation experiment runs

Open
#54 2 comments 0 reactions 1 assignee Claimed by @asrujana-44 View on GitHub
known issue
Dominant language
Python
Stars
5.9k
Forks
660
PR merge metrics
No merged PRs in 30d

Description

### What happened?

The `agents-cli eval submit` command does not create experiments on the agent platform. Is this supposed to happen?

### Steps to Reproduce

1. Deploy the agent to agent_runtime - `agents-cli deploy`
2. Run `agents-cli eval generate`
3. and the `agents-cli eval submit`
4. Go to the Evaluations inside the agent deployment on GCP console.

### What did you expect to happen?

Eval runs to be listed as experiments in the GCP console.

### Client information

Client Information

Run `agents-cli info` to output debugging information about your client.

### Command Output / Logs

_No response_

### Anything else we need to know?

_No response_

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.