Kaggle / Kaggle/kaggle-cli

Checksum verification not available through API, making --force necessary

Open
#233 1 comment 2 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
7.5k
Forks
1.4k
Avg merge
3d 15h
Merged PRs (30d)
11

Description

Hello!

I was doing a coding challenge and noticed that the Kaggle API did not yet support checksum verification. You could name any file dataset.zip, and if Kaggle detected that the file with the same name existed, it would silently exit and say the file was successfully downloaded. I was wondering whether there are plans on the roadmap to include checksum verification of downloaded files, and whether Kaggle generates and caches checksums for datasets at upload time. I think this is important in order to effectively make the API scriptable and to effectively include Kaggle as part of some workflow pipelines. As a workaround, I am generating checksums myself, matching them with known datasets, and including them within my method calls on top of the API to know when to force a re-download. Otherwise I'm not sure if Kaggle already has this feature and I'm just using the API wrong.

If this is a feature gap and Kaggle is open for open source contributors, please let me know.

Thanks
Ying

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.