firecrawl / firecrawl/firecrawl-mcp-server
Add policy enforcement to prevent runaway crawls and credit burn
- Dominant language
- JavaScript
- Stars
- 7.5k
- Forks
- 884
- Avg merge
- 1d 11h
- Merged PRs (30d)
- 14
Description
This server exposes ~10 tools including recursive crawling, batch scraping, deep research, and browser session control. Several can consume significant API credits or interact with sites in uncontrolled ways:
- `firecrawl_crawl` -- recursive site crawl with no built-in depth/page limit enforcement at the MCP layer
- `firecrawl_deep_research` -- autonomous multi-step research that can chain many API calls
- `firecrawl_batch_scrape` -- bulk operations across many URLs
- Browser session tools -- remote browser control
An agent in a loop calling `firecrawl_crawl` can burn through API credits rapidly.
**Suggestion:** Consider documenting support for [PolicyLayer/Intercept](https://github.com/policylayer/intercept), an open-source MCP proxy that enforces policies on tool calls before execution.
Example policy:
```yaml
version: "1"
default: allow
tools:
firecrawl_crawl:
rules:
- rate_limit: 3/hour
firecrawl_deep_research:
rules:
- action: require_approval
firecrawl_batch_scrape:
rules:
- rate_limit: 5/day
```
One line to set up: `npx -y @policylayer/intercept init`
Contributor guide
No contributing guide indexed for this repository
Research direction
No documentation file or test is named. Start by locating the server's documentation entry point and reviewing the listed crawl, research, batch-scrape, and browser-session tools; verify the PolicyLayer/Intercept setup command and example policies. Done means the supported integration and its limits are documented clearly without changing tool behavior.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- javascript, node.js, yaml
- Domain
- documentation, security
- Issue type
- Documentation
- Difficulty
- 2/5
- Estimated time
- 1-3 hours
- Activity status
- Quiet
- Clarity
- Mostly clear
- Newbie friendliness
- 45/100