awslabs / awslabs/sagemaker-debugger

Saving tensors and scalars which are not part of model graph

Open
#155 0 comments 0 reactions 0 assignees View on GitHub
documentation FAQ question wontfix
Dominant language
Python
Stars
165
Forks
82
PR merge metrics
No merged PRs in 30d

Description

Q. In the example I created, I needed to save data that is not part of the model training. I did this by calling directly hook._write_raw_tensor_simple(), which worked fine. But is this the recommended way?

For saving scalars, yes it is possible to save any arbitrary scalar from code. Please refer to save_scalar method in this part of docs - https://github.com/awslabs/sagemaker-debugger/blob/59de1452edd5d00252813d00425ef357541f51d9/docs/api.md#common-hook-api

For saving raw tensor which is not part of model graph, we don't have implementation currently.
Please refer to https://github.com/awslabs/sagemaker-debugger/issues/154 for updates

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.