awslabs / awslabs/sagemaker-debugger
Pytorch tensors are not saved with include_collections=["all"], only with save_all=True
Open
- Dominant language
- Python
- Stars
- 165
- Forks
- 82
- PR merge metrics
- No merged PRs in 30d
Description
Events produced are empty when using include_collections=["all"]. Works with save_all=True.
Hook code:
save_config = smd.SaveConfig(save_interval=1)
reduction_config = smd.ReductionConfig(["max", "min"])
hook = smd.Hook(out_dir='...',
reduction_config=reduction_config,
save_all=True,
#include_collections=["all"],
export_tensorboard=True,
save_config=save_config,
tensorboard_dir='...',
include_workers="all")
Contributor guide
Assessment
This issue has not been assessed yet.