aws-samples / aws-samples/amazon-bedrock-samples

Amazon Bedrock Evaluations not available for NVIDIA models (Super + Nano)

Open
#704 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Jupyter Notebook
Stars
1.5k
Forks
734
Avg merge
1d 6h
Merged PRs (30d)
4

Description

Hi Team,

When trying to use the following model IDs for both Nemotron 3 Super 120B and Nano 30B for a Bedrock Model Evaluation job I receive the identifier is invalid.

"nvidia.nemotron-super-3-120b"
"nvidia.nemotron-nano-3-30b"

To check if I could also run this in the console, it also failed based on the model identifier (images below).

Ask: Can this fix be remedied both programmatically and within the AWS console?

Many thanks y'all!

Curt


Image
Image

Contributor guide

Open the contributing guide

Research direction

Start by reproducing the failure in an Amazon Bedrock Model Evaluation job with the two NVIDIA model IDs listed in the issue, then compare the programmatic flow with the AWS console flow. Done means both model identifiers are accepted for evaluation jobs in the affected paths, or the repository documents that the limitation is outside its control.

Written by the indexing model from the issue text.

Assessment

Tech stack
aws
Domain
ai, cloud
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Quiet
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.