openml / openml/OpenML

Dataset hash issues

Open
#508 20 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

bug priority: highest
Dominant language
PHP
Stars
755
Forks
128
PR merge metrics
No merged PRs in 30d

Description

I realized that some datasets have issues with their md5 hash. Check for example:

wget https://www.openml.org/data/v1/download/61/iris.arff && md5sum iris.arff
wget https://www.openml.org/api/v1/data/61 && cat 61 | grep md5_checksum

showing that either the md5 checksum for the dataset, or the dataset is broken.

Overall, 19 datasets have this problem in total: 61, 250, 252, 299, 310, 311, 316, 537, 543, 1029, 1547, 1548, 1549, 1551, 1552, 1553, 1554, 1555, 4546

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start with the two wget/md5sum checks shown in the issue, comparing each of the 19 listed dataset IDs with its API md5_checksum. Determine whether each mismatch is caused by the stored checksum or the downloaded dataset, then verify that all affected datasets and checksum values agree.

Written by the indexing model from the issue text.

Assessment

Domain
data
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
42/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.