dgtlmoon / dgtlmoon/changedetection.io

[bug?] on one site - Exception: 'utf-8' codec can't encode character '\ud83d' - surrogates not allowed

Open
#2,597 5 comments 0 reactions 1 assignee Claimed by @dgtlmoon View on GitHub
triage
Dominant language
Python
Stars
34.1k
Forks
2k
Avg merge
23h 38m
Merged PRs (30d)
67

Description

**Describe the bug**
When checking for changes, changedetection reports the following error:

`Exception: 'utf-8' codec can't encode character '\ud83d' in position 419201: surrogates not allowed`. From what I gather, "\ud83d" is an emoji, yet I can't find one on the site I'm monitoring. I also check the site's code and couldn't find anything.

This is what the log says:

```
2024-08-29 08:09:30.784 | INFO | changedetectionio.update_worker:run:255 - Processing watch UUID 57a8a843-ba19-4f8b-9588-8ed7df2601dc Priority 1 URL https://www.pourmoi.co.uk/products/india-lace-plunge-body/
2024-08-29 08:09:30.785 | WARNING | changedetectionio.processors:call_browser:73 - Using playwright fetcher override for possible puppeteer request in browsersteps, because puppetteer:browser steps is incomplete.
2024-08-29 08:09:40.907 | ERROR | changedetectionio.update_worker:run:477 - Exception reached processing watch UUID: 57a8a843-ba19-4f8b-9588-8ed7df2601dc
2024-08-29 08:09:40.907 | ERROR | changedetectionio.update_worker:run:478 - 'utf-8' codec can't encode character '\ud83d' in position 419201: surrogates not allowed
```

**Version**
v0.46.03

**To Reproduce**

Steps to reproduce the behavior:
1. Click on recheck.

https://changedetection.io/share/i8HXmCg5dIga

**Expected behavior**
The check should complete without errors.

**Desktop (please complete the following information):**
- OS: Unraid
- Browser Chrome "browserless"
- Version unknown

**Additional context**
Interestingly enough, when going through the browser steps myself, no error is reported and a screenshot of the site is saved. Removing the browser steps does not prevent the error from appearing though.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.