axetroy / axetroy/crawler

Cloudflare support?

Open
#49 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
TypeScript
Stars
41
Forks
8
PR merge metrics
No merged PRs in 30d

Description

Will it be to request a feature to bypass cloudflare recaptcha? This might help https://github.com/codemanki/cloudscraper .
I have my crawler built with https://github.com/matthewmueller/x-ray and cloudscraper and it works for me.
But I'll be doing a big rewrite of the system so I'm looking for alternatives and this project has caught my eye.

Contributor guide

No contributing guide indexed for this repository

Research direction

No files, tests, or entry points are mentioned. Start by locating the crawler's request path and reviewing how it handles Cloudflare challenges, then clarify whether support means bypassing reCAPTCHA or another integration and define acceptance criteria before implementation.

Written by the indexing model from the issue text.

Assessment

Tech stack
nodejs, typescript
Domain
backend
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
15/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.