microsoft / microsoft/qlib

Can't use collector.py to update data since 2020-09-25

Open
#1,626 7 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

bug
Dominant language
Python
Stars
48.7k
Forks
7.7k
PR merge metrics
No merged PRs in 30d

Description

2023-08-17 12:35:27.211 | WARNING | data_collector.utils:wrapper:491 - _get_simple: 1 :get data error: 000001.sz--2020-01-01 00:00:00+08:00--2020-08-25 00:00:00+08:00The stock may be delisted, please check
2023-08-17 12:35:38.291 | WARNING | collector:get_data_from_remote:147 - get data error: 000001.sz--2020-01-01 00:00:00+08:00--2020-08-25 00:00:00+08:00Your data request fails. This may be caused by your firewall (e.g. GFW). Please switch your network if you want to access Yahoo! data
2023-08-17 12:35:38.292 | WARNING | data_collector.utils:wrapper:491 - _get_simple: 2 :get data error: 000001.sz--2020-01-01 00:00:00+08:00--2020-08-25 00:00:00+08:00The stock may be delisted, please check
2023-08-17 12:35:49.387 | WARNING | collector:get_data_from_remote:147 - get data error: 000001.sz--2020-01-01 00:00:00+08:00--2020-08-25 00:00:00+08:00Your data request fails. This may be caused by your firewall (e.g. GFW). Please switch your network if you want to access Yahoo! data
2023-08-17 12:35:49.388 | WARNING | data_collector.utils:wrapper:491 - _get_simple: 3 :get data error: 000001.sz--2020-01-01 00:00:00+08:00--2020-08-25 00:00:00+08:00The stock may be delisted, please check
2023-08-17 12:36:00.467 | WARNING | collector:get_data_from_remote:147 - get data error: 000001.sz--2020-01-01 00:00:00+08:00--2020-08-25 00:00:00+08:00Your data request fails. This may be caused by your firewall (e.g. GFW). Please switch your network if you want to access Yahoo! data
i have already close my firewall.

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start in collector.py at get_data_from_remote and trace the calls into data_collector.utils. Reproduce the failed request for 000001.sz and determine why the Yahoo! data request fails despite the reporter disabling the firewall. Done means collector.py can update the affected data successfully.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
data-engineering
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.