awslabs / awslabs/sagemaker-debugger
Download tensor to local disk and use it as disk cache
Open
enhancement
- Dominant language
- Python
- Stars
- 165
- Forks
- 82
- PR merge metrics
- No merged PRs in 30d
Description
Current;y, we access s3 for downloading a tensor, instead we should allow disk to be used as cache, rather than going to s3 each time.
Contributor guide
Research direction
Start by locating the tensor download path and the existing S3 access in the repository. Trace how repeated downloads are requested, then define done as storing downloaded tensors on local disk and reusing that cache instead of accessing S3 each time.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- aws, python
- Domain
- cloud, machine-learning
- Issue type
- Feature
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 38/100