tensorflow / tensorflow/datasets

Trying to load pre downloaded Imagenet2012 validation set only.

Open
#3,154 1 comment 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

help
Dominant language
Python
Stars
4.6k
Forks
1.6k
Avg merge
3h 54m
Merged PRs (30d)
1

Description

What I need help with / What I was wondering
I am trying to load only validation set for ImageNet2012, and I have already it downloaded and have been able to load it no problem in Pytorch, but I need to load it for TensorFlow models. How do I only load and use the validation set?

What I've tried so far
I have tried tfds builder and load but there doesn't seem to be an option for only loading the validation data set without it trying to download the training data, which I don't have the hard drive space for.

It would be nice if...
I could find documentation or examples of how to load pre downloaded ImageNet 2012 validation set only.

Environment information
(if applicable)

  • Operating System: In docker on Ubuntu 18.04 running in WSL 2
  • Python version: 3.7 or 3.8 not sure exactly
  • tensorflow-datasets/tfds-nightly version: tensorflow-datasets 4.2.0
  • tensorflow/tensorflow-gpu/tf-nightly/tf-nightly-gpu version: tf-nightly 2.6.0-dev20210408

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start by reviewing the TensorFlow Datasets builder and load behavior for ImageNet2012, focusing on whether a pre-downloaded validation split can be selected without downloading training data. Check the existing documentation and examples for split selection and local dataset files. Done means adding documentation or an example that shows how to load only the validation set.

Written by the indexing model from the issue text.

Assessment

Tech stack
python, tensorflow
Domain
data, machine-learning
Issue type
Documentation
Difficulty
2/5
Estimated time
1-3 hours
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
30/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.