Kaggle / Kaggle/kaggle-cli

404 when downloading single file of a large dataset

Open
#295 1 comment 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
7.5k
Forks
1.4k
Avg merge
3d 15h
Merged PRs (30d)
11

Description

Hi,

I'm trying to download only one file of the `jorijnsmit/binance-full-history` dataset. (it's a large dataset containing ~1000 files, don't need all of them)

First of all, when lissing files with `kaggle d files jorijnsmit/binance-full-history`, I only get:
```
name size creationDate
-------------------- ----- -------------------
AE-BNB.parquet 11MB 2020-08-22 23:52:30
AGI-ETH.parquet 15MB 2020-08-22 23:52:30
ADA-BNB.parquet 22MB 2020-08-22 23:52:30
AE-BTC.parquet 27MB 2020-08-22 23:52:30
ADA-TUSD.parquet 11MB 2020-08-22 23:52:30
ADAUP-USDT.parquet 944KB 2020-08-22 23:52:30
ADA-BTC.parquet 37MB 2020-08-22 23:52:30
ADA-BKRW.parquet 563KB 2020-08-22 23:52:30
ADA-PAX.parquet 5MB 2020-08-22 23:52:30
AGI-BTC.parquet 21MB 2020-08-22 23:52:30
ADADOWN-USDT.parquet 868KB 2020-08-22 23:52:30
ADA-ETH.parquet 34MB 2020-08-22 23:52:30
AE-ETH.parquet 20MB 2020-08-22 23:52:30
ADX-ETH.parquet 20MB 2020-08-22 23:52:30
AGI-BNB.parquet 9MB 2020-08-22 23:52:30
ADX-BTC.parquet 28MB 2020-08-22 23:52:30
ADA-BUSD.parquet 6MB 2020-08-22 23:52:30
ADA-USDT.parquet 38MB 2020-08-22 23:52:30
ADA-USDC.parquet 9MB 2020-08-22 23:52:30
ADX-BNB.parquet 13MB 2020-08-22 23:52:30
```

And trying to download a file:

`kaggle d download -p /data/test -f AGI-ETH.parquet jorijnsmit/binance-full-history` works perfectly
when
`kaggle d download -p /data/test -f AION-BNB.parquet jorijnsmit/binance-full-history` returns `404 - Not Found`
even if `AION-BNB.parquet` exists in the dataset

*NOTE* that if I `kaggle d download -p /data/test jorijnsmit/binance-full-history` everything works great, and `AION-BNB.parquet` is downloaded with the rest of the dataset (but I don't want to download 12Gigs each time i wish to update 5-10 files..)

Any ideas ?

**Infos:**
python v3.8
kaggle v1.5.6 (tried downgrading to v1.5.3, same issue)

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.