程序不停的跑一天，大概要花10G以上流量，能降低速度吗?
Open
- Dominant language
- Python
- Stars
- 23.7k
- Forks
- 5.4k
- PR merge metrics
- No merged PRs in 30d
Description
如题！
我没有改代码的抓取逻辑，部署到服务器上发现一天要跑10G流量。
由于我使用不是特别多，需求只是想用的时候有10个左右能用的代理就行，能否配置一下可以让程序**低速**抓取IP？
Contributor guide
No contributing guide indexed for this repository
Research direction
No file or test is named. Start by locating the proxy crawler's scheduling and configuration entry points, then measure how request rate relates to daily traffic. Done means users can configure a lower collection speed and the deployment no longer generates excessive traffic while maintaining roughly ten usable proxies.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- backend, networking, performance
- Issue type
- Feature
- Difficulty
- 3/5
- Estimated time
- 1-2 days
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 25/100