dgtlmoon / dgtlmoon/changedetection.io

[feature] add pluggable support for hrequests

Open
#1,930 1 comment 1 reaction 0 assignees View on GitHub
enhancement
Dominant language
Python
Stars
34.1k
Forks
2k
Avg merge
22h 52m
Merged PRs (30d)
70

Description

This looks like a cool library, especially the browser TLS fingerprint replication

https://github.com/daijro/hrequests

> Website bot detection systems typically do not correlate the TLS fingerprint browser version with the browser header.

> By adding more randomization to our headers, we can make our requests appear to be coming from a larger number of clients. We can make it seem like our requests are coming from a larger number of clients. This makes it harder for websites to identify and block our requests based on a consistent browser version.

Contributor guide

Open the contributing guide

Research direction

Start by reviewing the hrequests project linked in the issue and how changedetection.io currently makes requests. Define the integration points and confirm what pluggable support, header randomization, and browser TLS fingerprint replication should cover; done requires an agreed design and working integration.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
backend, networking
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.