aws-samples / aws-samples/amazon-bedrock-client-for-mac

[FEATURE] support application inference profiles

Open
#105 0 comments 0 reactions 1 assignee Claimed by @didhd View on GitHub
enhancement
Dominant language
Swift
Stars
446
Forks
45
PR merge metrics
No merged PRs in 30d

Description

**Feature description**
Instead of system-defined cross-region inference profiles (e.g. "us.anthropic..."), support application inference profiles.

**Problem it solves (optional)**
My company uses application inference profiles for (a) cost tracking and (b) per-user per-model access controls. For example, Bob can only use the app-inference-profile assigned to him.

**Proposed solution**
Use list-inference-profiles to populate a dropdown of existing model ARNs, both system and application types.
Allow the user to select or type in a model ARN.
Determine dynamically (using get-inference-profile) what the base model is (e.g. sonnet 3, opus 4, etc) to determine model capabilities.

Roocode and Cline have an interface that allows the user to select a "base model" (the system defined cross-region profile) and enter a custom model id (the application inference profile model ARN).

**Alternatives considered (optional)**
use a different LLM front end

**Additional context (optional)**
n/a

**Environment (optional)**
- macOS version: 15.5
- Amazon Bedrock Client for Mac version: 1.3.10

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.