Uses netlas (a rate limited service) for subdomain scan
Nobody has claimed this yet.
- Dominant language
- Python
- Stars
- 5.6k
- Forks
- 1.2k
- Avg merge
- 1d 21h
- Merged PRs (30d)
- 16
Description
The subdomain scan module (subdomain.yaml) uses netlas, specially https://app.netlas.io/api/domains/?q=*.{target} to pull out publicly seen subdomains. This is a rate limited service, with the free version only giving like 3 or 4 requests every 10 hours (My numbers might be off but they are somewhat similar).
This is not documented. This leads to the subdomain scan returning adequate information sometimes and nothing the other times due to the rate limit. The subdomain scan uses around 11 such databases, there might be more which are rate limited in a similar way.
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start with the subdomain scan module in subdomain.yaml and review its Netlas request to understand where the rate-limited service is used. Document Netlas's request limitations and explain that scans may return no results after the limit is reached; also check the module's other database sources for similar constraints.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- security
- Issue type
- Documentation
- Difficulty
- 2/5
- Estimated time
- 1-3 hours
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 45/100