awslabs / awslabs/generative-ai-cdk-constructs
(sagemaker-model-deployment): Support AWS Inferentia instance types
- Dominant language
- TypeScript
- Stars
- 541
- Forks
- 77
- Avg merge
- 1d 3h
- Merged PRs (30d)
- 8
Description
### Describe the feature
I'd like to be able to use AWS Inferentia for my endpoint inference containers
### Use Case
-
### Proposed Solution
_No response_
### Other Information
_No response_
### Acknowledgements
- [X] I may be able to implement this feature request
- [ ] This feature might incur a breaking change
Contributor guide
Research direction
The issue names the sagemaker-model-deployment feature and AWS Inferentia endpoint inference containers, but identifies no files or tests. Start by locating the construct's instance-type configuration and existing deployment coverage. Done means an endpoint can use an Inferentia instance type with appropriate validation and tests.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- aws, typescript
- Domain
- cloud, infrastructure, machine-learning
- Issue type
- Feature
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 30/100