Cannot filter strange symbols
- Dominant language
- Python
- Stars
- 2.2k
- Forks
- 296
- PR merge metrics
- No merged PRs in 30d
Description
I am using this script for google search:
```
read string
query=`echo $string|sed 's/ /+/g'`
curl -H 'User-Agent: Mozilla/5.0 (Windows NT 10.0; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/52.0.2743.116 Safari/537.36' -H 'Connection: keep-alive' https://www.google.com/search?q=$query|html2text --surrogate-escape --escape-all --protect-links|sed 's/├//g;s/á//g;s/┬//g;s/ª//g;s/╕//g;s/«//g;s/╛//g;s/░//g;s/º//g;s/Ñ//g;s/Γ//g;s/ó//g;s/╢//g;s/¼//g;s/¬//g;s/╦//g;s/┼//g;s/╜//g;s/┐//g;s/ñ//g'|vim -
```
But had no luck replacing this strange symbols like:
à ¦¯à ¦¦à ¦¿ à ¦â¢Ã §Ÿà §â¡Ã ¦⢠à ¦¸à §â¡Ã ¦â¢Ã §â¡Ã ¦¨à §à ¦¡à §â¡Ã ¦° à ¦®à ¦§à §à ¦¯à §â¡
à ¦â à ¦à ¦¨à ¦¿ à ¦â¦Ã ¦¨à §à ¦¯ à ¦¸à ¦¾à ¦â¡Ã ¦Ÿà §⡠à ¦¨à ¦¾ à ¦¯à ¦¾à ¦¨ à ¦¤à ¦¾à ¦¹à ¦²à §â¡
[à ¦à ¦âà ¦¾à ¦¨à §â¡]()
à ¦â¢Ã §à ¦²à ¦¿à ¦⢠à ¦â¢Ã ¦°à §à ¦¨
..........................
..........................
........ please check out my generated output.txt
- Version by `html2text --version`
2017.10.4
- Python version `python --version`
python 3.6.2
Contributor guide
Assessment
This issue has not been assessed yet.