aws-samples / aws-samples/sample-for-amazon-bda-agents

Nova Pro does not support on-demand throughput for agent

Open
#2 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
8
Forks
1
PR merge metrics
No merged PRs in 30d

Description

In "Step 3: Test the Strands agent", I get the following error:

```
Testing Strands Agent with Knowledge Base integration...
============================================================

Test 1: Which cities have the lowest scores?
----------------------------------------
Error: An error occurred (ValidationException) when calling the ConverseStream operation: Invocation of model ID amazon.nova-pro-v1:0 with on-demand throughput isn’t supported. Retry your request with the ID or ARN of an inference profile that contains this model.
```

Fix is to change the model string used by the agent to an inference profile:

`model = BedrockModel(model_id="us.amazon.nova-pro-v1:0")`

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.