tensorflow / tensorflow/datasets
Trying to load pre downloaded Imagenet2012 validation set only.
Nobody has claimed this yet.
- Dominant language
- Python
- Stars
- 4.6k
- Forks
- 1.6k
- Avg merge
- 3h 54m
- Merged PRs (30d)
- 1
Description
What I need help with / What I was wondering
I am trying to load only validation set for ImageNet2012, and I have already it downloaded and have been able to load it no problem in Pytorch, but I need to load it for TensorFlow models. How do I only load and use the validation set?
What I've tried so far
I have tried tfds builder and load but there doesn't seem to be an option for only loading the validation data set without it trying to download the training data, which I don't have the hard drive space for.
It would be nice if...
I could find documentation or examples of how to load pre downloaded ImageNet 2012 validation set only.
Environment information
(if applicable)
- Operating System: In docker on Ubuntu 18.04 running in WSL 2
- Python version: 3.7 or 3.8 not sure exactly
tensorflow-datasets/tfds-nightlyversion: tensorflow-datasets 4.2.0tensorflow/tensorflow-gpu/tf-nightly/tf-nightly-gpuversion: tf-nightly 2.6.0-dev20210408
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start by reviewing the TensorFlow Datasets builder and load behavior for ImageNet2012, focusing on whether a pre-downloaded validation split can be selected without downloading training data. Check the existing documentation and examples for split selection and local dataset files. Done means adding documentation or an example that shows how to load only the validation set.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python, tensorflow
- Domain
- data, machine-learning
- Issue type
- Documentation
- Difficulty
- 2/5
- Estimated time
- 1-3 hours
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 30/100