aws / aws/sagemaker-huggingface-inference-toolkit
Support of Multi-model Endpoint using HuggingFace inference toolkit
Open
- Dominant language
- Python
- Stars
- 270
- Forks
- 60
- PR merge metrics
- No merged PRs in 30d
Description
Hi,
Does SageMaker huggingface inference toolkit supports multi-model endpoint ?
Contributor guide
Research direction
The issue asks whether the SageMaker Hugging Face inference toolkit supports multi-model endpoints. Start by reviewing the repository's Python entry points and existing SageMaker inference behavior; done means confirming the current support status or defining and implementing the missing capability.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- aws, huggingface, python
- Domain
- cloud, machine-learning
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 15/100