BuilderIO / BuilderIO/gpt-crawler
Adding proxy support?
Open
- Dominant language
- TypeScript
- Stars
- 22.4k
- Forks
- 2.4k
- PR merge metrics
- No merged PRs in 30d
Description
A lot of websites have anti-crawler protection, maybe it's a good idea to add proxy support?
Contributor guide
No contributing guide indexed for this repository
Research direction
The issue names no files, tests, or entry points. First review the crawler's current request configuration and define the proxy requirements, including how proxies are supplied and what anti-crawler cases must be supported; done should include documented behavior and coverage for the chosen configuration.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- typescript
- Domain
- networking
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100