aws / aws/amazon-sagemaker-examples

[Example Request] Hosting Dolly-12b model on SageMaker

Open
#4,130 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Jupyter Notebook
Stars
11k
Forks
7k
Avg merge
8h 29m
Merged PRs (30d)
8

Description

**Describe the use case example you want to see**
Hosting Dolly-12b model on SageMaker

**How would this example be used? Please describe.**
Hosting Dolly-12b model on SageMaker

**Describe which SageMaker services are involved**
SageMaker Inference/Hosting

**Describe what other services (other than SageMaker) are involved***
S3, ECR

**Describe which dataset could be used. Provide its location in s3://sagemaker-sample-files or another source.**
NA

Contributor guide

Open the contributing guide

Research direction

Start by reviewing existing SageMaker inference and hosting examples in the repository, then compare how they use S3 and ECR for model deployment. The issue provides no target file, dataset, or acceptance test, so define a reproducible Dolly-12b hosting and inference check before implementation.

Written by the indexing model from the issue text.

Assessment

Tech stack
aws, jupyter-notebook, machine-learning
Domain
cloud, machine-learning
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.