aws / aws/sagemaker-python-sdk

Sagemaker Local mode with cached pip installs

Open
#4,026 1 comment 2 reactions 1 assignee Claimed by @mollyheamazon View on GitHub
component: local mode type: feature request
Dominant language
Python
Stars
2.3k
Forks
1.3k
Avg merge
1d 22h
Merged PRs (30d)
35

Description

**Describe the feature you'd like**
In local mode I would like to be able to cache the pip installs made for preprocess, train and evaluate steps. This would make local development faster as I wouldn't need to re install `torch` for instance that takes a long time.

**How would this feature be used? Please describe.**

In local development we need the containers to have dependencies installed, docker-compose caches steps if they are in the compose yml file. If they are not, then the installation gets redone every time.

**Describe alternatives you've considered**

Provide examples on how to add a requirements file that get's cached in docker containers between local executions.

**Additional context**
Add any other context or screenshots about the feature request here.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.