jhao104 / jhao104/proxy_pool

好像没办法伪装成功,网页还是能抓取真实ip

Open
#701 4 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
23.7k
Forks
5.4k
PR merge metrics
No merged PRs in 30d

Description

请大佬们帮忙看看,没办法伪装成功,网页还是能抓取真实ip!

测试代码:
```
import requests

session = requests.Session()

res = session.get("http://demo.spiderpy.cn/get/")
ans = res.json()
print(ans.get("region", None), ans.get("proxy", None))
if ans.get("https"):

proxies = {'https': "https://{}".format(ans.get("proxy"))}
else:
proxies = {'http': "http://{}".format(ans.get("proxy"))}

session.proxies = proxies
header = {
'Content-Type': 'application/x-www-form-urlencoded',
'User-Agent': 'Mozilla/5.0 (Linux; Android 6.0; Nexus 5 Build/MRA58N) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/97.0.4692.99 Mobile Safari/537.36 Edg/97.0.1072.76'
}

ip_res = session.get("http://mip.chinaz.com/", timeout=10, headers=header, verify=False)

print(ip_res.json().get("origin"))

```

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.