JustAnotherArchivist / JustAnotherArchivist/snscrape

Weibo: "User does not exist" when using --name on certain accounts

Open
#444 10 comments 0 reactions 0 assignees View on GitHub
bug module:weibo
Dominant language
Python
Stars
5.4k
Forks
783
PR merge metrics
No merged PRs in 30d

Description

Haven't tested with user IDs.

```
~/u/steam ❯❯❯ python3 parse_weibo.deduped >> weibo.jsonl
['snscrape', '--jsonl', '--progress', 'weibo-user', '--name', 'fangshengmeng']
2022-04-03 22:27:12.723 WARNING snscrape.modules.weibo User does not exist
Finished, 0 results
['snscrape', '--jsonl', '--progress', 'weibo-user', '--name', 'qukean']
2022-04-03 22:27:14.052 WARNING snscrape.modules.weibo User does not exist
Finished, 0 results
['snscrape', '--jsonl', '--progress', 'weibo-user', '--name', 'yetuavg']
2022-04-03 22:27:15.280 WARNING snscrape.modules.weibo User does not exist
Finished, 0 results
['snscrape', '--jsonl', '--progress', 'weibo-user', '--name', 'zhangfrank110']
2022-04-03 22:27:16.472 WARNING snscrape.modules.weibo User does not exist
Finished, 0 results
```

With verbose output (can't get locals because it didn,t crash; you should add an option to dump them anyway):

```
~/u/steam ❯❯❯ snscrape -v --progress --jsonl weibo-user --name fangshengmeng 2
2022-04-03 22:29:29.953 INFO snscrape.base Retrieving https://m.weibo.cn/n/fangshengmeng
2022-04-03 22:29:31.017 INFO snscrape.base Retrieved https://m.weibo.cn/n/fangshengmeng: 200
2022-04-03 22:29:31.017 WARNING snscrape.modules.weibo User does not exist
2022-04-03 22:29:31.017 INFO snscrape._cli Done, found 0 results
Finished, 0 results
```

Also it seems really unintuitive to have to add --name as an option if it's not a user ID; could this be fixed like it was with the Twitter scraper, i.e. seeing if it's an int?

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.