tensorflow / tensorflow/datasets
[data request] CIFAR10-H
Open
Nobody has claimed this yet.
dataset request
- Dominant language
- Python
- Stars
- 4.6k
- Forks
- 1.6k
- Avg merge
- 3h 54m
- Merged PRs (30d)
- 1
Description
- Name of dataset: CIFAR10-H
- URL of dataset: https://github.com/jcpeterson/cifar-10h
- License of dataset: Creative Commons BY-NC-SA 4.0 license
- Short description of dataset and use case(s): A re-labeled version of CIFAR-10's test set with soft-labels coming from real human annotators. For every pair (image, label) in the original CIFAR-10 test set, it provides several additional labels given by real human annotators as well as the average soft-label. The training set is identical to the one of the original dataset. This dataset is useful in the study of label noise and uncertainty in machine learning.
Folks who would also like to see this dataset in tensorflow/datasets, please thumbs-up so the developers can know which requests to prioritize.
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start by reading the CIFAR10-H repository linked in the issue, including its data format, labels, and license terms, then compare those requirements with existing dataset implementations in tensorflow/datasets. Done means CIFAR10-H is integrated as a usable dataset with appropriate metadata and validation, subject to confirming that its license is acceptable.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- data, machine-learning
- Issue type
- Feature
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 35/100