aws / aws/agentcore-cli

CLI support for Evaluation Online Eval Config sessionTimeoutMinutes and filter

Open
#906 0 comments 0 reactions 0 assignees View on GitHub
bug
Dominant language
TypeScript
Stars
283
Forks
95
Avg merge
1d 2h
Merged PRs (30d)
183

Description

### Description

AgentCore cli is missing the support for `sessionTImeoutMinutes` and filters when create a new online evaluation config.
The boto3 API spec indicates that the the `create-online-evaluation-config` has optional parameters `sessionTimeoutMinutes` and `filters`.

```
response = client.create_online_evaluation_config(
clientToken='string',
onlineEvaluationConfigName='string',
description='string',
rule={
'samplingConfig': {
'samplingPercentage': 123.0
},
'filters': [
{
'key': 'string',
'operator': 'Equals'|'NotEquals'|'GreaterThan'|'LessThan'|'GreaterThanOrEqual'|'LessThanOrEqual'|'Contains'|'NotContains',
'value': {
'stringValue': 'string',
'doubleValue': 123.0,
'booleanValue': True|False
}
},
],
'sessionConfig': {
'sessionTimeoutMinutes': 123
}
},
dataSourceConfig={
'cloudWatchLogs': {
'logGroupNames': [
'string',
],
'serviceNames': [
'string',
]
}
},
evaluators=[
{
'evaluatorId': 'string'
},
],
evaluationExecutionRoleArn='string',
enableOnCreate=True|False,
tags={
'string': 'string'
}
)
```

### Steps to Reproduce

1. Run `agentcore add` --> OnlineEvalConfig
2. I should be able to specify the `sessionTimeoutMinutes` and `filter`

### Expected Behavior

Should be able to specify `sessionTimeoutMinutes` and `filter` during online evaluation config creation.

### Actual Behavior

The cli only let me select SamplingConfig but not sessionTimeoutMinutes or rules

### CLI Version

_No response_

### Operating System

macOS

### Additional Context

_No response_

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.