CLI support for Evaluation Online Eval Config sessionTimeoutMinutes and filter
- Dominant language
- TypeScript
- Stars
- 283
- Forks
- 95
- Avg merge
- 1d 2h
- Merged PRs (30d)
- 183
Description
### Description
AgentCore cli is missing the support for `sessionTImeoutMinutes` and filters when create a new online evaluation config.
The boto3 API spec indicates that the the `create-online-evaluation-config` has optional parameters `sessionTimeoutMinutes` and `filters`.
```
response = client.create_online_evaluation_config(
clientToken='string',
onlineEvaluationConfigName='string',
description='string',
rule={
'samplingConfig': {
'samplingPercentage': 123.0
},
'filters': [
{
'key': 'string',
'operator': 'Equals'|'NotEquals'|'GreaterThan'|'LessThan'|'GreaterThanOrEqual'|'LessThanOrEqual'|'Contains'|'NotContains',
'value': {
'stringValue': 'string',
'doubleValue': 123.0,
'booleanValue': True|False
}
},
],
'sessionConfig': {
'sessionTimeoutMinutes': 123
}
},
dataSourceConfig={
'cloudWatchLogs': {
'logGroupNames': [
'string',
],
'serviceNames': [
'string',
]
}
},
evaluators=[
{
'evaluatorId': 'string'
},
],
evaluationExecutionRoleArn='string',
enableOnCreate=True|False,
tags={
'string': 'string'
}
)
```
### Steps to Reproduce
1. Run `agentcore add` --> OnlineEvalConfig
2. I should be able to specify the `sessionTimeoutMinutes` and `filter`
### Expected Behavior
Should be able to specify `sessionTimeoutMinutes` and `filter` during online evaluation config creation.
### Actual Behavior
The cli only let me select SamplingConfig but not sessionTimeoutMinutes or rules
### CLI Version
_No response_
### Operating System
macOS
### Additional Context
_No response_
Contributor guide
Assessment
This issue has not been assessed yet.