tensorflow / tensorflow/datasets

NonMatchingChecksumError for flic dataset

Open
#3,568 1 comment 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

bug
Dominant language
Python
Stars
4.6k
Forks
1.6k
Avg merge
3h 54m
Merged PRs (30d)
1

Description

/!\ PLEASE INCLUDE THE FULL STACKTRACE AND CODE SNIPPET

Short description
The checksum for flic is wrong when loading the dataset

Environment information

  • Google Colab

  • tf version: <2.7.0>

  • tfds version: <4.0.1>

  • Does the issue still exists with the last tfds-nightly package (pip install --upgrade tfds-nightly) ? Yes, I tried to install version 4.4.0+nightly, still the same problem

Reproduction instructions

import tensorflow as tf
import tensorflow_datasets as tfds
(ds_train, ds_test), ds_info = tfds.load('flic', split=['train', 'test'], with_info = True)

If you share a colab, make sure to update the permissions to share it.

Link to logs

NonMatchingChecksumError: Artifact https://drive.google.com/uc?id=0B4K3PZp8xXDJN0Fpb0piVjQ3Y3M&export=download, downloaded to /root/tensorflow_datasets/downloads/ucid_0B4K3PZp8xXDJN0Fpb0piVjQ3_export_downloadNUNzS-8Kt3-vJib4tdOUecY-WZkH0MGFw6Ic-27T47U.tmp.11f9b56413a04e4e84eec15d3df20ae4/ServiceLogin, has wrong checksum. This might indicate:
 * The website may be down (e.g. returned a 503 status code). Please check the url.
 * For Google Drive URLs, try again later as Drive sometimes rejects downloads when too many people access the same URL. See https://github.com/tensorflow/datasets/issues/1482
 * The original datasets files may have been updated. In this case the TFDS dataset builder should be updated to use the new files and checksums. Sorry about that. Please open an issue or send us a PR with a fix.
 * If you're adding a new dataset, don't forget to register the checksums as explained in: https://www.tensorflow.org/datasets/add_dataset#2_run_download_and_prepare_locally

Expected behavior
I expect the dataset to be downloaded without any checksum errors.

Additional context
I do not think the website is down since I am still able to download from the url

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start by running the provided tfds.load('flic') reproduction with the stated TensorFlow and TFDS versions, then inspect the Google Drive download URL and the flic dataset builder's recorded checksum. Confirm whether the downloaded artifact differs from the expected file and whether the URL still returns the dataset rather than a login response. Done means the flic train and test splits download and prepare without NonMatchingChecksumError.

Written by the indexing model from the issue text.

Assessment

Tech stack
python, tensorflow
Domain
data, machine-learning
Issue type
Bug
Difficulty
3/5
Estimated time
1-2 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.