jhao104 / jhao104/proxy_pool

API 无数据返回

Open
#448 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
23.7k
Forks
5.4k
PR merge metrics
No merged PRs in 30d

Description

您好,很荣幸最近在github上看到了您的项目。在我本地运行调试时发现127.0.0.1:5010无法获取数据。经过测试127.0.0.1:5010/get_all无法获取到数据,列表显示为空,但是在redis里面有数据,经过追踪和调查发现ProxyManager.py无法获取数据输出返回。(注:最后一张图是单执行ProxyScheduler.py的图片,单独运行有清洗能力)这让我很不解,由于刚学爬虫不久追踪问题能力有限,所以来此请教。
![image](https://user-images.githubusercontent.com/58742950/80869768-ecadf400-8cd4-11ea-98d0-b4f961b3753b.png)

![image](https://user-images.githubusercontent.com/58742950/80869758-de5fd800-8cd4-11ea-9722-1adc155470e8.png)

![image](https://user-images.githubusercontent.com/58742950/80869883-7493fe00-8cd5-11ea-8228-d068984173f1.png)

Contributor guide

No contributing guide indexed for this repository

Research direction

Start by inspecting ProxyManager.py and the /get_all entry point, then compare its behavior with the standalone ProxyScheduler.py run described in the issue. Verify that Redis contains the expected data and trace where the response becomes empty. Done means /get_all returns the stored proxy list when the service runs on 127.0.0.1:5010.

Written by the indexing model from the issue text.

Assessment

Tech stack
python, redis
Domain
api, backend, databases
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.