[问题] 程序报错退出，似乎是因为无法再查看二级评论导致的，但是输出提示词中时而又能加载出二级评论

⚠️ 提交前确认

• [ 1] 我已经仔细阅读了项目使用过程中的常见问题汇总
• [1 ] 我已经搜索并查看了已关闭的issues
• [ 1] 我确认这不是由于滑块验证码、Cookie过期、Cookie提取错误、平台风控等常见原因导致的问题

❓ 问题描述

程序报错退出，似乎是因为无法再查看二级评论导致的，但是输出提示词中时而又能加载出二级评论，在网页中点击“展开回复”并未弹出滑块，而是显示：“展开回复失败”

🔍 使用场景

• 目标平台: 抖音
• 使用功能: 爬取评论

💻 环境信息

• 操作系统:
• Python版本: 3.9.23
• 是否使用IP代理: 用了快代理
• 是否使用VPN翻墙软件：否
• 目标平台(抖音/小红书/微博等): 抖音

📋 错误日志

D:\Anaconda3\envs\mc39\python.exe E:/0Python/MediaCrawler-main/main.py
2025-08-27 07:39:09 httpx INFO (_client.py:1740) - HTTP Request: GET https://dps.kdlapi.com//api/getdps/?secret_id=o583a7uhho1zmsq6kbuj&signature=p5qnf281bc81dvajzzclvvxwjxt25nfm&pt=1&format=json&sep=1&f_et=1&num=1 "HTTP/1.1 200 OK"
2025-08-27 07:39:09 MediaCrawler INFO (proxy_ip_pool.py:64) - [ProxyIpPool._is_valid_proxy] testing 183.130.152.114 is it valid
2025-08-27 07:39:11 httpx INFO (_client.py:1740) - HTTP Request: GET https://echo.apifox.cn/ "HTTP/1.1 200 OK"
2025-08-27 07:39:11 MediaCrawler INFO (core.py:59) - [DouYinCrawler] 使用CDP模式启动浏览器
2025-08-27 07:39:11 MediaCrawler INFO (cdp_browser.py:94) - [CDPBrowserManager] 检测到浏览器: Google Chrome (正在现有的浏览器会话中打开。)
2025-08-27 07:39:11 MediaCrawler INFO (cdp_browser.py:97) - [CDPBrowserManager] 浏览器路径: C:\Program Files\Google\Chrome\Application\chrome.exe
2025-08-27 07:39:11 MediaCrawler INFO (cdp_browser.py:137) - [CDPBrowserManager] 用户数据目录: E:\0Python\MediaCrawler-main\browser_data\cdp_dy_user_data_dir
2025-08-27 07:39:11 MediaCrawler INFO (browser_launcher.py:152) - [BrowserLauncher] 启动浏览器: C:\Program Files\Google\Chrome\Application\chrome.exe
2025-08-27 07:39:11 MediaCrawler INFO (browser_launcher.py:153) - [BrowserLauncher] 调试端口: 9222
2025-08-27 07:39:11 MediaCrawler INFO (browser_launcher.py:154) - [BrowserLauncher] 无头模式: False
2025-08-27 07:39:11 MediaCrawler INFO (browser_launcher.py:183) - [BrowserLauncher] 等待浏览器在端口 9222 上准备就绪...
2025-08-27 07:39:13 MediaCrawler INFO (browser_launcher.py:192) - [BrowserLauncher] 浏览器已在端口 9222 上准备就绪
2025-08-27 07:39:14 MediaCrawler INFO (cdp_browser.py:111) - [CDPBrowserManager] CDP端口 9222 可访问
2025-08-27 07:39:15 httpx INFO (_client.py:1740) - HTTP Request: GET http://localhost:9222/json/version "HTTP/1.1 200 OK"
2025-08-27 07:39:15 MediaCrawler INFO (cdp_browser.py:175) - [CDPBrowserManager] 获取到浏览器WebSocket URL: ws://localhost:9222/devtools/browser/4a4e5847-cb29-4f86-a59b-ae0d6cab6b6d
2025-08-27 07:39:15 MediaCrawler INFO (cdp_browser.py:194) - [CDPBrowserManager] 正在通过CDP连接到浏览器: ws://localhost:9222/devtools/browser/4a4e5847-cb29-4f86-a59b-ae0d6cab6b6d
2025-08-27 07:39:15 MediaCrawler INFO (cdp_browser.py:200) - [CDPBrowserManager] 成功连接到浏览器
2025-08-27 07:39:15 MediaCrawler INFO (cdp_browser.py:201) - [CDPBrowserManager] 浏览器上下文数量: 1
2025-08-27 07:39:15 MediaCrawler INFO (cdp_browser.py:226) - [CDPBrowserManager] 使用现有的浏览器上下文
2025-08-27 07:39:16 MediaCrawler INFO (cdp_browser.py:258) - [CDPBrowserManager] 已添加反检测脚本: libs/stealth.min.js
2025-08-27 07:39:16 MediaCrawler INFO (core.py:305) - [DouYinCrawler] CDP浏览器信息: {'version': '139.0.7258.139', 'contexts_count': 1, 'debug_port': 9222, 'is_connected': True}
2025-08-27 07:39:20 httpx INFO (_client.py:1740) - HTTP Request: GET https://www.douyin.com/aweme/v1/web/aweme/detail/?aweme_id=7540911530745892122&device_platform=webapp&aid=6383&channel=channel_pc_web&version_code=190600&version_name=19.6.0&update_version_code=170400&pc_client_type=1&cookie_enabled=true&browser_language=zh-CN&browser_platform=MacIntel&browser_name=Chrome&browser_version=125.0.0.0&browser_online=true&engine_name=Blink&os_name=Mac+OS&os_version=10.15.7&cpu_core_num=8&device_memory=8&engine_version=109.0&platform=PC&screen_width=2560&screen_height=1440&effective_type=4g&round_trip_time=50&webid=5159111356299111048&msToken=vdCVpV0rlWpo5j-7nxH-M4gsoswGA2mBj4gQcy6MRqYtjfXQS2zgnupMHjKPFQYqlltk6hI7I4ZIBd4_H88FGwUdmUFSB7jDS4RPp4xqbL-X-jiYY9tL5WB9iysSuSm_Q5IPu2N7PKUC74OzgrQJiwr4gtdMPBAQ9dp_YxyTKJzu&a_bogus=YJWZMDuDdEdsDf6h5InLfY3q6UF3YM9r0trEMD2fOV31Gg39HMYt9exolGzvB0gjis%2FmIeYjy4hbT3ohrQ2y8qwf9W0L%2F25gsDSkKl12so0j53inCLf%2FE0iE5hsAtFH8svr4iKi8owICSYyhldAJ5kIlO62-zo0%2F9Xj%3D "HTTP/1.1 200 OK"
2025-08-27 07:39:20 MediaCrawler ERROR (client.py:197) - [DouYinClient] Blocked or empty response (status=200) url=https://www.douyin.com/aweme/v1/web/aweme/detail/
2025-08-27 07:39:36 httpx INFO (_client.py:1740) - HTTP Request: GET https://www.douyin.com/aweme/v1/web/aweme/detail/?aweme_id=7540911530745892122&device_platform=webapp&aid=6383&channel=channel_pc_web&version_code=190600&version_name=19.6.0&update_version_code=170400&pc_client_type=1&cookie_enabled=true&browser_language=zh-CN&browser_platform=MacIntel&browser_name=Chrome&browser_version=125.0.0.0&browser_online=true&engine_name=Blink&os_name=Mac+OS&os_version=10.15.7&cpu_core_num=8&device_memory=8&engine_version=109.0&platform=PC&screen_width=2560&screen_height=1440&effective_type=4g&round_trip_time=50&webid=5159111356299111048&msToken=vdCVpV0rlWpo5j-7nxH-M4gsoswGA2mBj4gQcy6MRqYtjfXQS2zgnupMHjKPFQYqlltk6hI7I4ZIBd4_H88FGwUdmUFSB7jDS4RPp4xqbL-X-jiYY9tL5WB9iysSuSm_Q5IPu2N7PKUC74OzgrQJiwr4gtdMPBAQ9dp_YxyTKJzu&a_bogus=YJWZMDuDdEdsDf6h5InLfY3q6UF3YM9r0trEMD2fOV31Gg39HMYt9exolGzvB0gjis%2FmIeYjy4hbT3ohrQ2y8qwf9W0L%2F25gsDSkKl12so0j53inCLf%2FE0iE5hsAtFH8svr4iKi8owICSYyhldAJ5kIlO62-zo0%2F9Xj%3D "HTTP/1.1 200 OK"
2025-08-27 07:39:36 MediaCrawler ERROR (client.py:197) - [DouYinClient] Blocked or empty response (status=200) url=https://www.douyin.com/aweme/v1/web/aweme/detail/
2025-08-27 07:39:39 httpx INFO (_client.py:1740) - HTTP Request: GET https://www.douyin.com/aweme/v1/web/aweme/detail/?aweme_id=7540911530745892122&device_platform=webapp&aid=6383&channel=channel_pc_web&version_code=190600&version_name=19.6.0&update_version_code=170400&pc_client_type=1&cookie_enabled=true&browser_language=zh-CN&browser_platform=MacIntel&browser_name=Chrome&browser_version=125.0.0.0&browser_online=true&engine_name=Blink&os_name=Mac+OS&os_version=10.15.7&cpu_core_num=8&device_memory=8&engine_version=109.0&platform=PC&screen_width=2560&screen_height=1440&effective_type=4g&round_trip_time=50&webid=5159111356299111048&msToken=vdCVpV0rlWpo5j-7nxH-M4gsoswGA2mBj4gQcy6MRqYtjfXQS2zgnupMHjKPFQYqlltk6hI7I4ZIBd4_H88FGwUdmUFSB7jDS4RPp4xqbL-X-jiYY9tL5WB9iysSuSm_Q5IPu2N7PKUC74OzgrQJiwr4gtdMPBAQ9dp_YxyTKJzu&a_bogus=YJWZMDuDdEdsDf6h5InLfY3q6UF3YM9r0trEMD2fOV31Gg39HMYt9exolGzvB0gjis%2FmIeYjy4hbT3ohrQ2y8qwf9W0L%2F25gsDSkKl12so0j53inCLf%2FE0iE5hsAtFH8svr4iKi8owICSYyhldAJ5kIlO62-zo0%2F9Xj%3D "HTTP/1.1 200 OK"
2025-08-27 07:39:39 MediaCrawler ERROR (client.py:197) - [DouYinClient] Blocked or empty response (status=200) url=https://www.douyin.com/aweme/v1/web/aweme/detail/
2025-08-27 07:39:44 httpx INFO (_client.py:1740) - HTTP Request: GET https://www.douyin.com/aweme/v1/web/aweme/detail/?aweme_id=7540911530745892122&device_platform=webapp&aid=6383&channel=channel_pc_web&version_code=190600&version_name=19.6.0&update_version_code=170400&pc_client_type=1&cookie_enabled=true&browser_language=zh-CN&browser_platform=MacIntel&browser_name=Chrome&browser_version=125.0.0.0&browser_online=true&engine_name=Blink&os_name=Mac+OS&os_version=10.15.7&cpu_core_num=8&device_memory=8&engine_version=109.0&platform=PC&screen_width=2560&screen_height=1440&effective_type=4g&round_trip_time=50&webid=5159111356299111048&msToken=vdCVpV0rlWpo5j-7nxH-M4gsoswGA2mBj4gQcy6MRqYtjfXQS2zgnupMHjKPFQYqlltk6hI7I4ZIBd4_H88FGwUdmUFSB7jDS4RPp4xqbL-X-jiYY9tL5WB9iysSuSm_Q5IPu2N7PKUC74OzgrQJiwr4gtdMPBAQ9dp_YxyTKJzu&a_bogus=YJWZMDuDdEdsDf6h5InLfY3q6UF3YM9r0trEMD2fOV31Gg39HMYt9exolGzvB0gjis%2FmIeYjy4hbT3ohrQ2y8qwf9W0L%2F25gsDSkKl12so0j53inCLf%2FE0iE5hsAtFH8svr4iKi8owICSYyhldAJ5kIlO62-zo0%2F9Xj%3D "HTTP/1.1 200 OK"
2025-08-27 07:39:44 MediaCrawler ERROR (client.py:197) - [DouYinClient] Blocked or empty response (status=200) url=https://www.douyin.com/aweme/v1/web/aweme/detail/
2025-08-27 07:39:49 httpx INFO (_client.py:1740) - HTTP Request: GET https://www.douyin.com/aweme/v1/web/aweme/detail/?aweme_id=7540911530745892122&device_platform=webapp&aid=6383&channel=channel_pc_web&version_code=190600&version_name=19.6.0&update_version_code=170400&pc_client_type=1&cookie_enabled=true&browser_language=zh-CN&browser_platform=MacIntel&browser_name=Chrome&browser_version=125.0.0.0&browser_online=true&engine_name=Blink&os_name=Mac+OS&os_version=10.15.7&cpu_core_num=8&device_memory=8&engine_version=109.0&platform=PC&screen_width=2560&screen_height=1440&effective_type=4g&round_trip_time=50&webid=5159111356299111048&msToken=vdCVpV0rlWpo5j-7nxH-M4gsoswGA2mBj4gQcy6MRqYtjfXQS2zgnupMHjKPFQYqlltk6hI7I4ZIBd4_H88FGwUdmUFSB7jDS4RPp4xqbL-X-jiYY9tL5WB9iysSuSm_Q5IPu2N7PKUC74OzgrQJiwr4gtdMPBAQ9dp_YxyTKJzu&a_bogus=YJWZMDuDdEdsDf6h5InLfY3q6UF3YM9r0trEMD2fOV31Gg39HMYt9exolGzvB0gjis%2FmIeYjy4hbT3ohrQ2y8qwf9W0L%2F25gsDSkKl12so0j53inCLf%2FE0iE5hsAtFH8svr4iKi8owICSYyhldAJ5kIlO62-zo0%2F9Xj%3D "HTTP/1.1 200 OK"
2025-08-27 07:39:49 MediaCrawler ERROR (client.py:197) - [DouYinClient] Blocked or empty response (status=200) url=https://www.douyin.com/aweme/v1/web/aweme/detail/
2025-08-27 07:39:54 MediaCrawler ERROR (core.py:170) - [DouYinCrawler.get_aweme_detail] Get aweme detail error: Request failed after 5 attempts; UnknownError: ; url=https://www.douyin.com/aweme/v1/web/aweme/detail/
2025-08-27 07:39:56 httpx INFO (_client.py:1740) - HTTP Request: GET https://www.douyin.com/aweme/v1/web/comment/list/?aweme_id=7540911530745892122&cursor=0&count=20&item_type=0&device_platform=webapp&aid=6383&channel=channel_pc_web&version_code=190600&version_name=19.6.0&update_version_code=170400&pc_client_type=1&cookie_enabled=true&browser_language=zh-CN&browser_platform=MacIntel&browser_name=Chrome&browser_version=125.0.0.0&browser_online=true&engine_name=Blink&os_name=Mac+OS&os_version=10.15.7&cpu_core_num=8&device_memory=8&engine_version=109.0&platform=PC&screen_width=2560&screen_height=1440&effective_type=4g&round_trip_time=50&webid=1311131013631141081&msToken=dvmg4I4jLdhl3fv-z2JS0tC3gkG8hxCKyyYKY9wC3CSJPfxiQEjKiZ8sD61PW6K_0MLTTaT6ZhmuPo7LB4aNMCKJgXHh7A2T1pptUsruQ8YWqpKD2R5zlv43efdAaIS1TOR43LS1gzneZ4GzIGYXtvfsswSC8Hp5QYhBiORysDreQK5YBsESGLk%3D&a_bogus=QvW0Mmgvdk6NkDWk5InLfY3q6RH3YM9r0trEMD2fKV31XL39HMOS9exolGzvqL8jis%2FmIeYjy4hbT3ohrQ2y8qwf9W0L%2F25gsDSkKl12so0j53inCLf%2FE0iE5hsAtFH8svr4iKi8owICSYyhldAJ5kIlO62-zo0%2F9fL%3D "HTTP/1.1 200 OK"
2025-08-27 07:39:56 MediaCrawler INFO (init.py:213) - [store.douyin.update_dy_aweme_comment] douyin aweme comment: 7540972655617966889, content: 他想让大家看见的，从来不是被框定的“纯净”，而是一个会哭会笑会发呆的普通人。[赞][赞]
2025-08-27 07:39:56 MediaCrawler INFO (init.py:213) - [store.douyin.update_dy_aweme_comment] douyin aweme comment: 7543039044645847859, content: 我“他”有一个好父亲
2025-08-27 07:39:56 MediaCrawler INFO (init.py:213) - [store.douyin.update_dy_aweme_comment] douyin aweme comment: 7541008087723098895, content: 我觉得他不想办民宿的原因也是害怕网友骂他……
2025-08-27 07:39:56 MediaCrawler INFO (init.py:213) - [store.douyin.update_dy_aweme_comment] douyin aweme comment: 7540986266184827707, content: 想哭了[流泪]爸爸说看不懂抖音的评论，还好看不懂，不然更心疼
2025-08-27 07:39:56 MediaCrawler INFO (init.py:213) - [store.douyin.update_dy_aweme_comment] douyin aweme comment: 7541002876941353764, content: 男的，纯路人，关于他，好的视频和不好的视频都看到过，没诋毁没玩梗，看完这个视频很有感触，Respect[赞]
2025-08-27 07:39:56 MediaCrawler INFO (init.py:213) - [store.douyin.update_dy_aweme_comment] douyin aweme comment: 7541006928898523964, content: 跟大部分人在职场一样，刚入职场啥都不懂，就听话照做不敢说不，几年下来有经验了，有点积蓄了，就有底气敢说不了
2025-08-27 07:39:56 MediaCrawler INFO (init.py:213) - [store.douyin.update_dy_aweme_comment] douyin aweme comment: 7540962653583115065, content: 哪有什么爽文男主，背后都是默默抗下所有的谩骂和批评，付出十倍的努力才有今天的成就吧[流泪][流泪]
2025-08-27 07:39:56 MediaCrawler INFO (init.py:213) - [store.douyin.update_dy_aweme_comment] douyin aweme comment: 7541220801497826108, content: 天哪，想发给父母的点滴的照片竟然被工作人员删了[流泪]
2025-08-27 07:39:56 MediaCrawler INFO (init.py:213) - [store.douyin.update_dy_aweme_comment] douyin aweme comment: 7541004535637820169, content: 他真的就是孤独的一棵树。跟他相同生长环境教育背景的发小朋友不理解的他现在的环境，跟他同一环境的明星网红不理解他成长背景下带来的价值观和认知选择。所以他的郁闷痛苦纠结…真的是无人诉诸，只能自己咽下自己面对
2025-08-27 07:39:56 MediaCrawler INFO (init.py:213) - [store.douyin.update_dy_aweme_comment] douyin aweme comment: 7540969159900562214, content: 在这种天翻地覆的变化中，感觉到他经历了抽筋剥骨的成长[赞]
2025-08-27 07:39:56 MediaCrawler INFO (init.py:213) - [store.douyin.update_dy_aweme_comment] douyin aweme comment: 7541011994989232954, content: 不知道他是害怕还是厌恶镜头，这里面他一直在回避镜头[流泪]他比大众想象的更有自尊和自强
2025-08-27 07:39:56 MediaCrawler INFO (init.py:213) - [store.douyin.update_dy_aweme_comment] douyin aweme comment: 7540997824722191161, content: 确实帅啊这个侧面，这种长相就很难普通啊。就走红那个视频，放到现在照样红
2025-08-27 07:39:56 MediaCrawler INFO (init.py:213) - [store.douyin.update_dy_aweme_comment] douyin aweme comment: 7541020246527984419, content: 跟父母产生分歧怎么做？我会让一步。太哲学了[流泪][流泪]
2025-08-27 07:39:56 MediaCrawler INFO (init.py:213) - [store.douyin.update_dy_aweme_comment] douyin aweme comment: 7541004998981993276, content: 他其实一直很聪明 之前只是碍于不太会说汉语不能表达自己
2025-08-27 07:39:56 MediaCrawler INFO (init.py:213) - [store.douyin.update_dy_aweme_comment] douyin aweme comment: 7540992162583823162, content: “ 平坦的路，冷静地走，曲折的路，坚定地走”你很棒[赞]
2025-08-27 07:39:56 MediaCrawler INFO (init.py:213) - [store.douyin.update_dy_aweme_comment] douyin aweme comment: 7541000559675851535, content: 和妹妹在一起，好帅的哥哥呀！
2025-08-27 07:39:56 MediaCrawler INFO (init.py:213) - [store.douyin.update_dy_aweme_comment] douyin aweme comment: 7541051098221708092, content: 我没啥恶意，但是看到他爸爸说看不懂汉语，不知道网暴，就还挺好的，好搞笑，挺豁达的一家人[捂脸]
2025-08-27 07:39:56 MediaCrawler INFO (init.py:213) - [store.douyin.update_dy_aweme_comment] douyin aweme comment: 7541009963675222825, content: 他好像很平静的失去了一部分自己
2025-08-27 07:39:56 MediaCrawler INFO (init.py:213) - [store.douyin.update_dy_aweme_comment] douyin aweme comment: 7540973237062026018, content: 很好哭
2025-08-27 07:39:56 MediaCrawler INFO (init.py:213) - [store.douyin.update_dy_aweme_comment] douyin aweme comment: 7541110314903126784, content: 我觉得他说出“他们觉得我身上有味道”这句话太震撼我了。。。
2025-08-27 07:39:58 httpx INFO (_client.py:1740) - HTTP Request: GET https://www.douyin.com/aweme/v1/web/comment/list/reply/?comment_id=7540972655617966889&cursor=0&count=20&item_type=0&item_id=7540911530745892122&device_platform=webapp&aid=6383&channel=channel_pc_web&version_code=190600&version_name=19.6.0&update_version_code=170400&pc_client_type=1&cookie_enabled=true&browser_language=zh-CN&browser_platform=MacIntel&browser_name=Chrome&browser_version=125.0.0.0&browser_online=true&engine_name=Blink&os_name=Mac+OS&os_version=10.15.7&cpu_core_num=8&device_memory=8&engine_version=109.0&platform=PC&screen_width=2560&screen_height=1440&effective_type=4g&round_trip_time=50&webid=1654837101933451213&msToken=dvmg4I4jLdhl3fv-z2JS0tC3gkG8hxCKyyYKY9wC3CSJPfxiQEjKiZ8sD61PW6K_0MLTTaT6ZhmuPo7LB4aNMCKJgXHh7A2T1pptUsruQ8YWqpKD2R5zlv43efdAaIS1TOR43LS1gzneZ4GzIGYXtvfsswSC8Hp5QYhBiORysDreQK5YBsESGLk%3D&a_bogus=YXRMBRgXdEVNffyX5InLfY3q6I13YMcr0trEMD2f4n3s1L39HMOG9exElGzvwNjjis%2FmIeYjy4hbT3ohrQ2y8qwf9W0L%2F25gsDSkKl12so0j53inCLf%2FE0iE5hsAtFH8svr4iKi8owICSYyhldAJ5kIlO62-zo0%2F9Xb%3D "HTTP/1.1 200 OK"
2025-08-27 07:39:58 MediaCrawler ERROR (client.py:197) - [DouYinClient] Blocked or empty response (status=200) url=https://www.douyin.com/aweme/v1/web/comment/list/reply/
2025-08-27 07:40:00 httpx INFO (_client.py:1740) - HTTP Request: GET https://www.douyin.com/aweme/v1/web/comment/list/reply/?comment_id=7540972655617966889&cursor=0&count=20&item_type=0&item_id=7540911530745892122&device_platform=webapp&aid=6383&channel=channel_pc_web&version_code=190600&version_name=19.6.0&update_version_code=170400&pc_client_type=1&cookie_enabled=true&browser_language=zh-CN&browser_platform=MacIntel&browser_name=Chrome&browser_version=125.0.0.0&browser_online=true&engine_name=Blink&os_name=Mac+OS&os_version=10.15.7&cpu_core_num=8&device_memory=8&engine_version=109.0&platform=PC&screen_width=2560&screen_height=1440&effective_type=4g&round_trip_time=50&webid=1654837101933451213&msToken=dvmg4I4jLdhl3fv-z2JS0tC3gkG8hxCKyyYKY9wC3CSJPfxiQEjKiZ8sD61PW6K_0MLTTaT6ZhmuPo7LB4aNMCKJgXHh7A2T1pptUsruQ8YWqpKD2R5zlv43efdAaIS1TOR43LS1gzneZ4GzIGYXtvfsswSC8Hp5QYhBiORysDreQK5YBsESGLk%3D&a_bogus=YXRMBRgXdEVNffyX5InLfY3q6I13YMcr0trEMD2f4n3s1L39HMOG9exElGzvwNjjis%2FmIeYjy4hbT3ohrQ2y8qwf9W0L%2F25gsDSkKl12so0j53inCLf%2FE0iE5hsAtFH8svr4iKi8owICSYyhldAJ5kIlO62-zo0%2F9Xb%3D "HTTP/1.1 200 OK"
2025-08-27 07:40:00 MediaCrawler ERROR (client.py:197) - [DouYinClient] Blocked or empty response (status=200) url=https://www.douyin.com/aweme/v1/web/comment/list/reply/
2025-08-27 07:40:03 httpx INFO (_client.py:1740) - HTTP Request: GET https://www.douyin.com/aweme/v1/web/comment/list/reply/?comment_id=7540972655617966889&cursor=0&count=20&item_type=0&item_id=7540911530745892122&device_platform=webapp&aid=6383&channel=channel_pc_web&version_code=190600&version_name=19.6.0&update_version_code=170400&pc_client_type=1&cookie_enabled=true&browser_language=zh-CN&browser_platform=MacIntel&browser_name=Chrome&browser_version=125.0.0.0&browser_online=true&engine_name=Blink&os_name=Mac+OS&os_version=10.15.7&cpu_core_num=8&device_memory=8&engine_version=109.0&platform=PC&screen_width=2560&screen_height=1440&effective_type=4g&round_trip_time=50&webid=1654837101933451213&msToken=dvmg4I4jLdhl3fv-z2JS0tC3gkG8hxCKyyYKY9wC3CSJPfxiQEjKiZ8sD61PW6K_0MLTTaT6ZhmuPo7LB4aNMCKJgXHh7A2T1pptUsruQ8YWqpKD2R5zlv43efdAaIS1TOR43LS1gzneZ4GzIGYXtvfsswSC8Hp5QYhBiORysDreQK5YBsESGLk%3D&a_bogus=YXRMBRgXdEVNffyX5InLfY3q6I13YMcr0trEMD2f4n3s1L39HMOG9exElGzvwNjjis%2FmIeYjy4hbT3ohrQ2y8qwf9W0L%2F25gsDSkKl12so0j53inCLf%2FE0iE5hsAtFH8svr4iKi8owICSYyhldAJ5kIlO62-zo0%2F9Xb%3D "HTTP/1.1 200 OK"
2025-08-27 07:40:03 MediaCrawler ERROR (client.py:197) - [DouYinClient] Blocked or empty response (status=200) url=https://www.douyin.com/aweme/v1/web/comment/list/reply/
2025-08-27 07:40:07 httpx INFO (_client.py:1740) - HTTP Request: GET https://www.douyin.com/aweme/v1/web/comment/list/reply/?comment_id=7540972655617966889&cursor=0&count=20&item_type=0&item_id=7540911530745892122&device_platform=webapp&aid=6383&channel=channel_pc_web&version_code=190600&version_name=19.6.0&update_version_code=170400&pc_client_type=1&cookie_enabled=true&browser_language=zh-CN&browser_platform=MacIntel&browser_name=Chrome&browser_version=125.0.0.0&browser_online=true&engine_name=Blink&os_name=Mac+OS&os_version=10.15.7&cpu_core_num=8&device_memory=8&engine_version=109.0&platform=PC&screen_width=2560&screen_height=1440&effective_type=4g&round_trip_time=50&webid=1654837101933451213&msToken=dvmg4I4jLdhl3fv-z2JS0tC3gkG8hxCKyyYKY9wC3CSJPfxiQEjKiZ8sD61PW6K_0MLTTaT6ZhmuPo7LB4aNMCKJgXHh7A2T1pptUsruQ8YWqpKD2R5zlv43efdAaIS1TOR43LS1gzneZ4GzIGYXtvfsswSC8Hp5QYhBiORysDreQK5YBsESGLk%3D&a_bogus=YXRMBRgXdEVNffyX5InLfY3q6I13YMcr0trEMD2f4n3s1L39HMOG9exElGzvwNjjis%2FmIeYjy4hbT3ohrQ2y8qwf9W0L%2F25gsDSkKl12so0j53inCLf%2FE0iE5hsAtFH8svr4iKi8owICSYyhldAJ5kIlO62-zo0%2F9Xb%3D "HTTP/1.1 200 OK"
2025-08-27 07:40:07 MediaCrawler ERROR (client.py:197) - [DouYinClient] Blocked or empty response (status=200) url=https://www.douyin.com/aweme/v1/web/comment/list/reply/
2025-08-27 07:40:13 httpx INFO (_client.py:1740) - HTTP Request: GET https://www.douyin.com/aweme/v1/web/comment/list/reply/?comment_id=7540972655617966889&cursor=0&count=20&item_type=0&item_id=7540911530745892122&device_platform=webapp&aid=6383&channel=channel_pc_web&version_code=190600&version_name=19.6.0&update_version_code=170400&pc_client_type=1&cookie_enabled=true&browser_language=zh-CN&browser_platform=MacIntel&browser_name=Chrome&browser_version=125.0.0.0&browser_online=true&engine_name=Blink&os_name=Mac+OS&os_version=10.15.7&cpu_core_num=8&device_memory=8&engine_version=109.0&platform=PC&screen_width=2560&screen_height=1440&effective_type=4g&round_trip_time=50&webid=1654837101933451213&msToken=dvmg4I4jLdhl3fv-z2JS0tC3gkG8hxCKyyYKY9wC3CSJPfxiQEjKiZ8sD61PW6K_0MLTTaT6ZhmuPo7LB4aNMCKJgXHh7A2T1pptUsruQ8YWqpKD2R5zlv43efdAaIS1TOR43LS1gzneZ4GzIGYXtvfsswSC8Hp5QYhBiORysDreQK5YBsESGLk%3D&a_bogus=YXRMBRgXdEVNffyX5InLfY3q6I13YMcr0trEMD2f4n3s1L39HMOG9exElGzvwNjjis%2FmIeYjy4hbT3ohrQ2y8qwf9W0L%2F25gsDSkKl12so0j53inCLf%2FE0iE5hsAtFH8svr4iKi8owICSYyhldAJ5kIlO62-zo0%2F9Xb%3D "HTTP/1.1 200 OK"
2025-08-27 07:40:13 MediaCrawler ERROR (client.py:197) - [DouYinClient] Blocked or empty response (status=200) url=https://www.douyin.com/aweme/v1/web/comment/list/reply/
2025-08-27 07:40:18 MediaCrawler ERROR (core.py:205) - [DouYinCrawler.get_comments] aweme_id: 7540911530745892122 get comments failed, error: Request failed after 5 attempts; UnknownError: ; url=https://www.douyin.com/aweme/v1/web/comment/list/reply/
2025-08-27 07:40:18 MediaCrawler INFO (core.py:103) - [DouYinCrawler.start] Douyin Crawler finished ...

Process finished with exit code 0

📷 错误截图

Start with client.py:197 and core.py:170, then trace the DouYinCrawler flow around the logged aweme detail and comment-list requests. Reproduce the crawl with the provided Python and CDP setup, compare the 200 responses that are treated as blocked or empty, and verify that comment crawling reports a clear result instead of exiting unexpectedly.