tensorflow / tensorflow/datasets
Add `tfds list` CLI command
Nobody has claimed this yet.
- Dominant language
- Python
- Stars
- 4.6k
- Forks
- 1.6k
- Avg merge
- 3h 54m
- Merged PRs (30d)
- 1
Description
Addition of community dataset will sharply increase the no of available datasets. So it will become difficult to browse through repos or catalog.
So, it would great if we can add a new CLI command to list all the datasets in present in TFDS. This will allows users to easily search a dataset using tools like grep.
Possible Usage
tfds list # List all datasets
tfds list --type audio # List all audio dataset in TFDS
tfds list --namespace huggingface # List all huggingface community dataset
tfds list --search sun # Lists datasets like sun397, lsun (alternative is to use grep)
Implementation details
• Use/modify the tfds.list_builder API.
• Add a new file list.py in scripts/cli folder
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start by reading the existing tfds.list_builder API and the scripts/cli entry points. Use the proposed list.py location and example invocations to determine how dataset listing, type, namespace, and search options should fit the CLI. Done means tfds list can enumerate datasets and support the requested filters.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- cli, data
- Issue type
- Feature
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 35/100