tensorflow / tensorflow/datasets

Resume dataset download if failed

Open
#1,077 1 comment 10 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

contributions welcome enhancement
Dominant language
Python
Stars
4.6k
Forks
1.6k
Avg merge
3h 54m
Merged PRs (30d)
1

Description

Is your feature request related to a problem? Please describe.
It's frustrating if trying to download a large dataset (e.g. imagenet, coco etc.) and for some reason the download fails. Apparently it does not continue where interrupted (or am I doing something wrong here?)

Describe the solution you'd like
Automatic resume of download if files already exist in the download folder

Describe alternatives you've considered
Downloading it manually. Would be nicer if its integrated, though.

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

The issue does not name a file, test, or entry point. Start by tracing the dataset download implementation and how existing files in the download folder are handled. Done means an interrupted large download can continue automatically from existing data, with coverage for the resumed-download behavior.

Written by the indexing model from the issue text.

Assessment

Tech stack
python, tensorflow
Domain
data
Issue type
Feature
Difficulty
3/5
Estimated time
1-2 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.