aws / aws/sagemaker-hyperpod-recipes
Feature: Add inference recipes
- Dominant language
- Python
- Stars
- 98
- Forks
- 29
- Avg merge
- 1h 10m
- Merged PRs (30d)
- 4
Description
## Describe the feature you'd like
It is nice that there are so many pre-training and fine-tuning examples in this project. It would be great to add examples of how to deploy these models and use them for offline/batch job and online/service inference.
## How would this feature be used?
Once I pre-train or fine-tune a model, I would like to serve it on SageMaker HyperPod, and use it either by submitting curl requests, or through a simple grad.io or other UI.
Contributor guide
Research direction
Start by reviewing the repository's existing pre-training and fine-tuning examples to understand how recipes are organized. Add examples covering deployment on SageMaker HyperPod for offline or batch jobs and online or service inference, with curl requests or a simple UI as the usage path.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- aws, python
- Domain
- cloud, machine-learning
- Issue type
- Feature
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 35/100