Add OpticParse multimodal vision web scraping and PhishVision security tools
Nobody has claimed this yet.
- Dominant language
- Python
- Stars
- 58.8k
- Forks
- 8.5k
- Avg merge
- 1d 15h
- Merged PRs (30d)
- 109
Description
Feature Request
Add native support for OpticParse (autonomous vision-based web scraping) and PhishVision (real-time zero-day phishing and crypto drainer detection) to lib/crewai-tools.
Motivation
Autonomous CrewAI multi-agent swarms frequently browse modern SPAs and untrusted websites. Traditional scraping tools fail on Cloudflare Turnstile challenges or dump noisy HTML into LLM context, while adversarial websites expose agents to zero-day credential harvesting and malicious wallet drainers.
Proposed Solution
- OpticParseTool: Renders dynamic JavaScript and Turnstile challenges, extracting token-optimized clean Markdown and JSON without brittle CSS selectors.
- PhishVisionTool: Pre-flight security sentinel auditing URLs for credential harvesting, typosquatting, and Web3 crypto drainers before agent navigation.
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start by reviewing the existing structure under lib/crewai-tools and how current tools are exposed and tested. The work is complete only when the intended OpticParse scraping capabilities and PhishVision security checks have defined integrations, behavior, and verification criteria.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- security, tooling, web-dev
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Active
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100