aws / aws/aws-cdk

Bedrock: Cross Region Inference Constructs

Open
#31,957 2 comments 0 reactions 0 assignees View on GitHub
@aws-cdk/bedrock effort/small feature-request p2
Dominant language
TypeScript
Stars
12.9k
Forks
4.6k
Avg merge
1d 19h
Merged PRs (30d)
74

Description

### Describe the feature

Abstractions for Bedrock cross region inference profiles and their identifiers ([see](https://docs.aws.amazon.com/bedrock/latest/userguide/cross-region-inference-support.html)), similar to those for Bedrock foundation models ([see](https://github.com/aws/aws-cdk/blob/main/packages/aws-cdk-lib/aws-bedrock/lib/foundation-model.ts))

### Use Case

To grant a principal permission to invoke a cross region inference profile along with the associated foundational model in all supported regions. For example ([see](https://docs.aws.amazon.com/bedrock/latest/userguide/cross-region-inference-support.html)), the US Anthropic Claude 3 Haiku profile is supported in `us-east-1` and `us-west-2`. To invoke this profile in `us-east-1` a principal must have permission to invoke the profile in `us-east-1` and the Anthropic Claude 3 Haiku foundation model in `us-east-1` and `us-west-2`.

### Proposed Solution

_No response_

### Other Information

The abstractions may also be useful for #31570

### Acknowledgements

- [X] I may be able to implement this feature request
- [X] This feature might incur a breaking change

### CDK version used

2.164.1

### Environment details (OS name and version, etc.)

macOS Sequoia 15.1

Contributor guide

Open the contributing guide

Research direction

Start by reading packages/aws-cdk-lib/aws-bedrock/lib/foundation-model.ts and the AWS cross-region inference support documentation linked in the issue. Define the required profile and identifier abstractions, including the associated foundation models and supported regions, so a principal can receive the permissions described in the use case; confirm compatibility with #31570.

Written by the indexing model from the issue text.

Assessment

Tech stack
aws, typescript
Domain
cloud, tooling
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
28/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.