awslabs / awslabs/sagemaker-debugger

Pytorch tensors are not saved with include_collections=["all"], only with save_all=True

Open
#112 1 comment 0 reactions 1 assignee Claimed by @vandanavk View on GitHub
Dominant language
Python
Stars
165
Forks
82
PR merge metrics
No merged PRs in 30d

Description

Events produced are empty when using include_collections=["all"]. Works with save_all=True.

Hook code:

save_config = smd.SaveConfig(save_interval=1)
reduction_config = smd.ReductionConfig(["max", "min"])
hook = smd.Hook(out_dir='...',
reduction_config=reduction_config,
save_all=True,
#include_collections=["all"],
export_tensorboard=True,
save_config=save_config,
tensorboard_dir='...',
include_workers="all")

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.