binance / binance/binance-public-data
Missing Klines for BTC USDT between 2017-2024 (1 sec interval)
- Dominant language
- Python
- Stars
- 2.5k
- Forks
- 613
- PR merge metrics
- No merged PRs in 30d
Description
Hello,
I have downloaded all mothly spot 1 second interval kline data for BTC/USDT. However, I realized that there were some missing intervals. Those intervals are listed below(prev date and current date namings are just for logging purposes):
Prev date: 2017-09-06 16:00:00 - current date: 2017-09-06 23:00:00
Prev date: 2017-12-04 06:00:20 - current date: 2017-12-04 06:49:06
Prev date: 2017-12-18 10:00:42 - current date: 2017-12-18 10:14:47
Prev date: 2017-12-18 12:29:13 - current date: 2017-12-18 13:34:10
Prev date: 2018-01-04 03:00:14 - current date: 2018-01-04 05:06:13
Prev date: 2018-02-08 00:28:14 - current date: 2018-02-09 10:00:01
Prev date: 2018-02-10 05:59:59 - current date: 2018-02-10 06:15:00
Prev date: 2018-02-11 04:00:00 - current date: 2018-02-11 04:35:00
Prev date: 2018-06-26 01:59:59 - current date: 2018-06-26 12:00:00
Prev date: 2018-06-27 12:59:59 - current date: 2018-06-27 14:45:00
Prev date: 2018-07-04 00:22:25 - current date: 2018-07-04 08:00:00
Prev date: 2018-10-19 05:59:59 - current date: 2018-10-19 09:30:00
Prev date: 2018-11-14 01:59:59 - current date: 2018-11-14 09:00:00
Prev date: 2019-03-12 01:59:59 - current date: 2019-03-12 08:00:00
Prev date: 2019-05-15 02:59:59 - current date: 2019-05-15 13:00:00
Prev date: 2019-06-07 21:13:13 - current date: 2019-06-07 22:15:00
Prev date: 2019-08-15 01:59:59 - current date: 2019-08-15 10:00:00
Prev date: 2019-11-13 01:59:59 - current date: 2019-11-13 04:20:00
Prev date: 2019-11-13 05:29:59 - current date: 2019-11-13 05:33:37
Prev date: 2019-11-25 01:59:59 - current date: 2019-11-25 04:00:00
Prev date: 2020-02-09 01:59:59 - current date: 2020-02-09 03:00:00
Prev date: 2020-02-19 11:35:32 - current date: 2020-02-19 17:30:00
Prev date: 2020-03-04 09:21:46 - current date: 2020-03-04 11:30:00
Prev date: 2020-04-25 01:59:59 - current date: 2020-04-25 04:30:00
Prev date: 2020-06-28 01:59:59 - current date: 2020-06-28 05:30:00
Prev date: 2020-11-30 05:59:59 - current date: 2020-11-30 07:00:00
Prev date: 2020-12-21 13:47:20 - current date: 2020-12-21 18:00:00
Prev date: 2020-12-25 01:59:59 - current date: 2020-12-25 03:00:00
Prev date: 2021-02-11 03:40:54 - current date: 2021-02-11 05:00:00
Prev date: 2021-03-06 01:59:59 - current date: 2021-03-06 03:30:00
Prev date: 2021-04-20 01:59:59 - current date: 2021-04-20 04:30:00
Prev date: 2021-04-25 04:00:58 - current date: 2021-04-25 08:45:00
Prev date: 2021-08-13 01:59:59 - current date: 2021-08-13 06:30:00
Prev date: 2021-09-29 06:59:59 - current date: 2021-09-29 09:00:00
Prev date: 2021-12-24 04:59:54 - current date: 2021-12-24 05:00:36
Prev date: 2023-03-24 12:39:41 - current date: 2023-03-24 14:00:00
Are these gaps missing as well in db or was there something wrong with the script? I have downloaded same data again but the issue persists. I have used this repo to download the data. Any help or comment is well appreciated. Thanks.
Contributor guide
No contributing guide indexed for this repository
Research direction
No file, test, or entry point is named. Start by comparing the listed gaps with the downloaded spot-data archives and then inspect the repository's download instructions or script to determine whether the gaps are present in the source data or introduced during downloading. Done means documenting the cause with reproducible evidence.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- data
- Issue type
- Bug
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100