aws-samples / aws-samples/amazon-bedrock-samples
Amazon Bedrock Evaluations not available for NVIDIA models (Super + Nano)
- Dominant language
- Jupyter Notebook
- Stars
- 1.5k
- Forks
- 734
- Avg merge
- 1d 6h
- Merged PRs (30d)
- 4
Description
Hi Team,
When trying to use the following model IDs for both Nemotron 3 Super 120B and Nano 30B for a Bedrock Model Evaluation job I receive the identifier is invalid.
"nvidia.nemotron-super-3-120b"
"nvidia.nemotron-nano-3-30b"
To check if I could also run this in the console, it also failed based on the model identifier (images below).
Ask: Can this fix be remedied both programmatically and within the AWS console?
Many thanks y'all!
Curt
Contributor guide
Research direction
Start by reproducing the failure in an Amazon Bedrock Model Evaluation job with the two NVIDIA model IDs listed in the issue, then compare the programmatic flow with the AWS console flow. Done means both model identifiers are accepted for evaluation jobs in the affected paths, or the repository documents that the limitation is outside its control.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- aws
- Domain
- ai, cloud
- Issue type
- Bug
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Quiet
- Clarity
- Mostly clear
- Newbie friendliness
- 35/100