awslabs / awslabs/generative-ai-cdk-constructs

(sagemaker-model-deployment): Support AWS Inferentia instance types

Open
#290 10 comments 0 reactions 0 assignees View on GitHub
backlog feature-request
Dominant language
TypeScript
Stars
541
Forks
77
Avg merge
1d 3h
Merged PRs (30d)
8

Description

### Describe the feature

I'd like to be able to use AWS Inferentia for my endpoint inference containers

### Use Case

-

### Proposed Solution

_No response_

### Other Information

_No response_

### Acknowledgements

- [X] I may be able to implement this feature request
- [ ] This feature might incur a breaking change

Contributor guide

Open the contributing guide

Research direction

The issue names the sagemaker-model-deployment feature and AWS Inferentia endpoint inference containers, but identifies no files or tests. Start by locating the construct's instance-type configuration and existing deployment coverage. Done means an endpoint can use an Inferentia instance type with appropriate validation and tests.

Written by the indexing model from the issue text.

Assessment

Tech stack
aws, typescript
Domain
cloud, infrastructure, machine-learning
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
30/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.