aws / aws/sagemaker-hyperpod-recipes

Feature: Add inference recipes

Open
#19 1 comment 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
98
Forks
29
Avg merge
1h 10m
Merged PRs (30d)
4

Description

## Describe the feature you'd like
It is nice that there are so many pre-training and fine-tuning examples in this project. It would be great to add examples of how to deploy these models and use them for offline/batch job and online/service inference.

## How would this feature be used?
Once I pre-train or fine-tune a model, I would like to serve it on SageMaker HyperPod, and use it either by submitting curl requests, or through a simple grad.io or other UI.

Contributor guide

Open the contributing guide

Research direction

Start by reviewing the repository's existing pre-training and fine-tuning examples to understand how recipes are organized. Add examples covering deployment on SageMaker HyperPod for offline or batch jobs and online or service inference, with curl requests or a simple UI as the usage path.

Written by the indexing model from the issue text.

Assessment

Tech stack
aws, python
Domain
cloud, machine-learning
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.