NanmiCoder / NanmiCoder/MediaCrawler
[问题] 请问微博按关键词搜索只能爬取50页吗，我每次都是53页左右报错停止
Open
Nobody has claimed this yet.
question
- Dominant language
- Python
- Stars
- 65.3k
- Forks
- 12.6k
- PR merge metrics
- No merged PRs in 30d
Description
⚠️ 提交前确认
- 我已经仔细阅读了项目使用过程中的常见问题汇总
- 我已经搜索并查看了已关闭的issues
- 我确认这不是由于滑块验证码、Cookie过期、Cookie提取错误、平台风控等常见原因导致的问题
❓ 问题描述
🔍 使用场景
- 目标平台: (如：小红书/抖音/微博等)
- 使用功能: (如：关键词搜索/用户主页爬取等)
💻 环境信息
- 操作系统:
- Python版本:
- 是否使用IP代理:
- 是否使用VPN翻墙软件：
- 目标平台(抖音/小红书/微博等):
📋 错误日志
在此粘贴完整的错误日志
📷 错误截图
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Begin with the Weibo keyword-search entry point and obtain the missing operating-system, Python, proxy/VPN, and complete error-log details. Reproduce the stop around page 53, then identify the cause and verify that keyword searches no longer stop unexpectedly.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- data-engineering
- Issue type
- Bug
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 15/100