NanmiCoder / NanmiCoder/MediaCrawler
微博爬取创作者数据的时候不断死循环，停不下来，爬取的都是同样的内容，还有一个问题是爬取的的内容没有照片的链接
Open
Nobody has claimed this yet.
待确认
- Dominant language
- Python
- Stars
- 65.3k
- Forks
- 12.6k
- PR merge metrics
- No merged PRs in 30d
Description
This issue has no description.
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start by locating the Weibo creator-crawling entry point and the code that collects post content and image URLs. Reproduce the crawl to identify why pagination repeats and whether image links are omitted from the extracted data. Done means the crawl terminates with new results and returned content includes photo links.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- data-engineering
- Issue type
- Bug
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100