binance / binance/binance-public-data

Missing Klines for BTC USDT between 2017-2024 (1 sec interval)

Open
#365 0 comments 0 reactions 0 assignees View on GitHub
reviewing
Dominant language
Python
Stars
2.5k
Forks
613
PR merge metrics
No merged PRs in 30d

Description

Hello,

I have downloaded all mothly spot 1 second interval kline data for BTC/USDT. However, I realized that there were some missing intervals. Those intervals are listed below(prev date and current date namings are just for logging purposes):

Prev date: 2017-09-06 16:00:00 - current date: 2017-09-06 23:00:00
Prev date: 2017-12-04 06:00:20 - current date: 2017-12-04 06:49:06
Prev date: 2017-12-18 10:00:42 - current date: 2017-12-18 10:14:47
Prev date: 2017-12-18 12:29:13 - current date: 2017-12-18 13:34:10
Prev date: 2018-01-04 03:00:14 - current date: 2018-01-04 05:06:13
Prev date: 2018-02-08 00:28:14 - current date: 2018-02-09 10:00:01
Prev date: 2018-02-10 05:59:59 - current date: 2018-02-10 06:15:00
Prev date: 2018-02-11 04:00:00 - current date: 2018-02-11 04:35:00
Prev date: 2018-06-26 01:59:59 - current date: 2018-06-26 12:00:00
Prev date: 2018-06-27 12:59:59 - current date: 2018-06-27 14:45:00
Prev date: 2018-07-04 00:22:25 - current date: 2018-07-04 08:00:00
Prev date: 2018-10-19 05:59:59 - current date: 2018-10-19 09:30:00
Prev date: 2018-11-14 01:59:59 - current date: 2018-11-14 09:00:00
Prev date: 2019-03-12 01:59:59 - current date: 2019-03-12 08:00:00
Prev date: 2019-05-15 02:59:59 - current date: 2019-05-15 13:00:00
Prev date: 2019-06-07 21:13:13 - current date: 2019-06-07 22:15:00
Prev date: 2019-08-15 01:59:59 - current date: 2019-08-15 10:00:00
Prev date: 2019-11-13 01:59:59 - current date: 2019-11-13 04:20:00
Prev date: 2019-11-13 05:29:59 - current date: 2019-11-13 05:33:37
Prev date: 2019-11-25 01:59:59 - current date: 2019-11-25 04:00:00
Prev date: 2020-02-09 01:59:59 - current date: 2020-02-09 03:00:00
Prev date: 2020-02-19 11:35:32 - current date: 2020-02-19 17:30:00
Prev date: 2020-03-04 09:21:46 - current date: 2020-03-04 11:30:00
Prev date: 2020-04-25 01:59:59 - current date: 2020-04-25 04:30:00
Prev date: 2020-06-28 01:59:59 - current date: 2020-06-28 05:30:00
Prev date: 2020-11-30 05:59:59 - current date: 2020-11-30 07:00:00
Prev date: 2020-12-21 13:47:20 - current date: 2020-12-21 18:00:00
Prev date: 2020-12-25 01:59:59 - current date: 2020-12-25 03:00:00
Prev date: 2021-02-11 03:40:54 - current date: 2021-02-11 05:00:00
Prev date: 2021-03-06 01:59:59 - current date: 2021-03-06 03:30:00
Prev date: 2021-04-20 01:59:59 - current date: 2021-04-20 04:30:00
Prev date: 2021-04-25 04:00:58 - current date: 2021-04-25 08:45:00
Prev date: 2021-08-13 01:59:59 - current date: 2021-08-13 06:30:00
Prev date: 2021-09-29 06:59:59 - current date: 2021-09-29 09:00:00
Prev date: 2021-12-24 04:59:54 - current date: 2021-12-24 05:00:36
Prev date: 2023-03-24 12:39:41 - current date: 2023-03-24 14:00:00

Are these gaps missing as well in db or was there something wrong with the script? I have downloaded same data again but the issue persists. I have used this repo to download the data. Any help or comment is well appreciated. Thanks.

Contributor guide

No contributing guide indexed for this repository

Research direction

No file, test, or entry point is named. Start by comparing the listed gaps with the downloaded spot-data archives and then inspect the repository's download instructions or script to determine whether the gaps are present in the source data or introduced during downloading. Done means documenting the cause with reproducible evidence.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
data
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.