NanmiCoder / NanmiCoder/MediaCrawler
请问大家快手爬取评论的时候，一直循环同样的日志信息。求助求助
Nobody has claimed this yet.
- Dominant language
- Python
- Stars
- 65.3k
- Forks
- 12.6k
- PR merge metrics
- No merged PRs in 30d
Description
2024-11-27 18:14:48 MediaCrawler INFO (init.py:69) - [store.kuaishou.batch_update_ks_video_comments] video_id:3x4j49p9ue5nnzc, comments:[]
2024-11-27 18:14:49 MediaCrawler INFO (client.py:241) - [KuaiShouClient.get_comments_all_sub_comments] Crawling sub_comment mode is not enabled
2024-11-27 18:14:49 MediaCrawler INFO (init.py:69) - [store.kuaishou.batch_update_ks_video_comments] video_id:3x4j49p9ue5nnzc, comments:[]
2024-11-27 18:14:50 MediaCrawler INFO (client.py:241) - [KuaiShouClient.get_comments_all_sub_comments] Crawling sub_comment mode is not enabled
2024-11-27 18:14:51 MediaCrawler INFO (init.py:69) - [store.kuaishou.batch_update_ks_video_comments] video_id:3x4j49p9ue5nnzc, comments:[]
2024-11-27 18:14:51 MediaCrawler INFO (client.py:241) - [KuaiShouClient.get_comments_all_sub_comments] Crawling sub_comment mode is not enabled
2024-11-27 18:14:52 MediaCrawler INFO (init.py:69) - [store.kuaishou.batch_update_ks_video_comments] video_id:3x4j49p9ue5nnzc, comments:[]
2024-11-27 18:14:53 MediaCrawler INFO (client.py:241) - [KuaiShouClient.get_comments_all_sub_comments] Crawling sub_comment mode is not enabled一直如此循环。
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start by tracing the Kuaishou comment-crawling flow from client.py:241 and the update logging at init.py:69. Reproduce the repeated messages using the log sequence in the issue, then identify where the loop fails to advance. Done means the same video no longer produces the repeated cycle and comment crawling progresses or exits.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- data-engineering
- Issue type
- Bug
- Difficulty
- 3/5
- Estimated time
- 1-2 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100