aws-samples / aws-samples/amazon-bedrock-samples
Accessing the Bedrock evaluation summary information
Open
- Dominant language
- Jupyter Notebook
- Stars
- 1.5k
- Forks
- 734
- Avg merge
- 1d 6h
- Merged PRs (30d)
- 4
Description
Is it possible to access the custom metrics score and the number of prompts values, in the Bedrock model evaluation summary, using Python SDK?
Contributor guide
Research direction
The issue names no repository file, test, or entry point. Start by checking the Python SDK's Bedrock model evaluation APIs against the summary shown in the attached image; done means establishing whether custom metrics and prompt counts are exposed, with a documented access path if they are.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- aws, python
- Domain
- ai, cloud
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 20/100