aws / aws/sagemaker-training-toolkit

How to save non-model artifacts from a container (output_data_dir)

Open
#80 2 comments 3 reactions 0 assignees View on GitHub
type: question
Dominant language
Python
Stars
530
Forks
140
Avg merge
1h 12m
Merged PRs (30d)
2

Description

**What did you find confusing? Please describe.**
I am using docker images with my custom training algorithm. I am interested in sending information back from the container (for example, saving coefficients from the fitted model on an S3 bucket). I am confused about the use of the folder opt/ml/output. I understand that files on the folder opt/ml/model will be saved to the output bucket, but what happens to files on opt/ml/output? Can they be saved as well?

**Describe how documentation can be improved**
There is very little information about the output_data_dir. This directory is defined on the environment.py module on the source code, but it seems unused on the other modules. How does sagemaker save files from the output folder to S3?
There is also very little information about the use of opt/ml/output besides the file failure.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.