tensorflow / tensorflow/datasets
NonMatchingChecksumError for flic dataset
Nobody has claimed this yet.
- Dominant language
- Python
- Stars
- 4.6k
- Forks
- 1.6k
- Avg merge
- 3h 54m
- Merged PRs (30d)
- 1
Description
/!\ PLEASE INCLUDE THE FULL STACKTRACE AND CODE SNIPPET
Short description
The checksum for flic is wrong when loading the dataset
Environment information
-
Google Colab
-
tfversion: <2.7.0> -
tfdsversion: <4.0.1> -
Does the issue still exists with the last
tfds-nightlypackage (pip install --upgrade tfds-nightly) ? Yes, I tried to install version 4.4.0+nightly, still the same problem
Reproduction instructions
import tensorflow as tf
import tensorflow_datasets as tfds
(ds_train, ds_test), ds_info = tfds.load('flic', split=['train', 'test'], with_info = True)
If you share a colab, make sure to update the permissions to share it.
Link to logs
NonMatchingChecksumError: Artifact https://drive.google.com/uc?id=0B4K3PZp8xXDJN0Fpb0piVjQ3Y3M&export=download, downloaded to /root/tensorflow_datasets/downloads/ucid_0B4K3PZp8xXDJN0Fpb0piVjQ3_export_downloadNUNzS-8Kt3-vJib4tdOUecY-WZkH0MGFw6Ic-27T47U.tmp.11f9b56413a04e4e84eec15d3df20ae4/ServiceLogin, has wrong checksum. This might indicate:
* The website may be down (e.g. returned a 503 status code). Please check the url.
* For Google Drive URLs, try again later as Drive sometimes rejects downloads when too many people access the same URL. See https://github.com/tensorflow/datasets/issues/1482
* The original datasets files may have been updated. In this case the TFDS dataset builder should be updated to use the new files and checksums. Sorry about that. Please open an issue or send us a PR with a fix.
* If you're adding a new dataset, don't forget to register the checksums as explained in: https://www.tensorflow.org/datasets/add_dataset#2_run_download_and_prepare_locally
Expected behavior
I expect the dataset to be downloaded without any checksum errors.
Additional context
I do not think the website is down since I am still able to download from the url
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start by running the provided tfds.load('flic') reproduction with the stated TensorFlow and TFDS versions, then inspect the Google Drive download URL and the flic dataset builder's recorded checksum. Confirm whether the downloaded artifact differs from the expected file and whether the URL still returns the dataset rather than a login response. Done means the flic train and test splits download and prepare without NonMatchingChecksumError.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python, tensorflow
- Domain
- data, machine-learning
- Issue type
- Bug
- Difficulty
- 3/5
- Estimated time
- 1-2 days
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 35/100