dgtlmoon / dgtlmoon/changedetection.io
[feature] Support compression with Basic HTTP Client
- Dominant language
- Python
- Stars
- 34.1k
- Forks
- 2k
- Avg merge
- 23h 38m
- Merged PRs (30d)
- 67
Description
**Version and OS**
v0.47.03 on linux/docker
**Is your feature request related to a problem? Please describe.**
I had to poll this URL recently: https://www.revolve.com/never-fully-dressed-atlantis-cardigan-in-blue/dp/NEVR-WK3/?size=M&code=NEVR-WK3
I observed that it only works with `curl` if I have a Chrome user agent **and** `--compressed`
**Describe the solution you'd like**
I don't think that I can enable compression with the basic HTTP agent, which is why my polling is failing, although I don't have conclusive evidence of this just that the curl works and the cd.io poll fails. I'd be very happy to get further debug if you tell me what you'd like to see.
**Describe the use-case and give concrete real-world examples**
[Attach any HTML/JSON, give links to sites, screenshots etc, we are not mind readers](https://www.revolve.com/never-fully-dressed-atlantis-cardigan-in-blue/dp/NEVR-WK3/?size=M&code=NEVR-WK3)
**Additional context**
Add any other context or screenshots about the feature request here.
Contributor guide
Research direction
Start by reproducing the linked URL with the Basic HTTP Client and compare it with curl --compressed, then trace the Basic HTTP agent entry point. Done means the client can request and process compressed responses for this case, with a regression check in the existing test structure if one is identified.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- networking
- Issue type
- Feature
- Difficulty
- 3/5
- Estimated time
- 1-2 days
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 35/100