awslabs / awslabs/bedrock-usage-analyzer

Custom Application Inference Profiles not available for selection in shown list

Open
#7 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
22
Forks
6
PR merge metrics
No merged PRs in 30d

Description

I have some custom application inference profiles setup for a number of Anthropic claude models and Amazon Nova models.

I installed the python module as shown in documentation.

Then i refreshed the models list for the only region i am using (ap-southeast-2).

Then I work my way through the interactive options ...
1. Confirm my account
2. Elect to use default granualrity settings
3. Select Anthropic as the provider
4. Select one of the available base models
5. Select one of the available Inference Profiles prefixes (the ones only shown to me are 1. au or 2. global)
Note: all my custom inference profiles are located in the ap-southeast-2 region but i am unsure of the inference profile prefix
6. It runs but no data for the model is present.

No data is present presumeably because i don't use the system inference profiles, I only use my custom application inference profiles.

Is there any option to list and use these as the basis for the anlysis and output?

Many Thanks.

Contributor guide

Open the contributing guide

Research direction

Start with the interactive model-selection flow described in the issue, especially the provider, base-model, and inference-profile-prefix steps. Trace how the refreshed regional model list is used, then verify that custom application inference profiles in ap-southeast-2 can be listed, selected, and produce usage data in the analysis output.

Written by the indexing model from the issue text.

Assessment

Tech stack
aws, python
Domain
cloud
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Quiet
Clarity
Mostly clear
Newbie friendliness
48/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.