Bring Data Extraction
to CrewAI
Learn how to connect Browse AI to CrewAI and start using 12 AI agent tools in minutes. Fully managed, enterprise secure, and ready to use without writing a single line of code.
GDPR Free for SubscribersCompatible with every major AI agent and IDE
Gemini
What is the Browse AI MCP Server?
Connect your Browse AI account to any AI agent and take full control of your no-code web scraping and automated monitoring workflows through natural conversation.
What you can do
- Robot Orchestration — List and manage all web scraping robots in your account programmatically, retrieving detailed configuration and high-fidelity extraction history
- Automated Task Execution — Programmatically trigger new robot runs with custom parameters (e.g., origin URL) to coordinate high-fidelity data collection in real-time
- Website Monitoring Intelligence — Create and manage monitoring schedules to track changes on any website and maintain a perfectly coordinated data pipeline
- Event Architecture — Access and monitor robot webhooks for instant notifications and retrieve detailed log metadata directly through your agent
- Financial Visibility — Programmatically track your account subscription status and credit usage to coordinate your automated data quotas efficiently
How it works
- Subscribe to this server
- Retrieve your Secret API Key from your Browse AI dashboard (Account > API)
- Start collecting web data and monitoring sites from Claude, Cursor, or any MCP client
No more manual logging into the dashboard to check individual extraction tasks. Your AI acts as your dedicated data engineer and monitoring coordinator.
Who is this for?
- Market Researchers — instantly trigger price scraping and competitive monitoring using natural language commands
- Growth Marketers — automate lead generation from public directories and track site changes without leaving your workspace
- Developers — integrate high-speed no-code scraping data into custom workflows through simple AI queries
Built-in capabilities (12)
Add new schedule
Get robot info
Check task progress
Check credit balance
Get account info
List scheduled scrapers
List bulk task runs
List past runs
Get event configs
List scraping robots
Delete robot webhook
Start scraping task
Why CrewAI?
When paired with CrewAI, Browse AI becomes a first-class tool in your multi-agent workflows. Each agent in the crew can call Browse AI tools autonomously, one agent queries data, another analyzes results, a third compiles reports, all orchestrated through Vinkius with zero configuration overhead.
- —
Multi-agent collaboration lets you decompose complex workflows into specialized roles, one agent researches, another analyzes, a third generates reports, each with access to MCP tools
- —
CrewAI's native MCP integration requires zero adapter code: pass Vinkius Edge URL directly in the
mcpsparameter and agents auto-discover every available tool at runtime - —
Built-in task delegation and shared memory mean agents can pass context between steps without manual state management, enabling multi-hop reasoning across tool calls
- —
Sequential and hierarchical crew patterns map naturally to real-world workflows: enumerate subdomains → analyze DNS history → check WHOIS records → compile findings into actionable reports
Browse AI in CrewAI
Browse AI and 4,000+ other MCP servers. One platform. One governance layer.
Teams that connect Browse AI to CrewAI through Vinkius don't need to source, host, or maintain individual MCP servers. Every tool call runs inside a hardened runtime with credential isolation, DLP, and a signed audit chain.
Raw MCP | Vinkius | |
|---|---|---|
| Server catalog | Find and host yourself | 4,000+ managed |
| Infrastructure | Self-hosted | Sandboxed V8 isolates |
| Credential handling | Plaintext in config | Vault + runtime injection |
| Data loss prevention | None | Configurable DLP policies |
| Kill switch | None | Global instant shutdown |
| Financial circuit breakers | None | Per-server limits + alerts |
| Audit trail | None | Ed25519 signed logs |
| SIEM log streaming | None | Splunk, Datadog, Webhook |
| Honeytokens | None | Canary alerts on leak |
| Custom domains | Not applicable | DNS challenge verified |
| GDPR compliance | Manual effort | Automated purge + export |
Why teams choose Vinkius for Browse AI in CrewAI
The Browse AI MCP Server runs on Vinkius-managed infrastructure inside AWS — a purpose-built runtime with per-request V8 isolates, Ed25519 signed audit chains, and sub-40ms cold starts. All 12 tools execute in hardened sandboxes optimized for native MCP execution.
Your AI agents in CrewAI only access the data you authorize, with DLP that blocks sensitive information from ever reaching the model, kill switch for instant shutdown, and up to 60% token savings. Enterprise-grade infrastructure, zero maintenance.
* Every MCP server runs on Vinkius-managed infrastructure inside AWS - a purpose-built runtime with per-request V8 isolates, Ed25519 signed audit chains, and sub-40ms cold starts optimized for native MCP execution. See our infrastructure
How Vinkius secures
Browse AI for CrewAI
Every tool call from CrewAI to the Browse AI MCP Server is protected by DLP redaction, cryptographic audit chains, V8 sandbox isolation, kill switch, and financial circuit breakers.
Frequently asked questions
How do I find my Browse AI Secret API Key?
Log in to your account, navigate to Account > API, and copy your Secret API Key.
Can I override the origin URL via AI?
Yes! The trigger_robot_run tool accepts a jsonInput parameter where you can provide an originUrl to override the robot's default settings.
How do I check my remaining credits?
Use the get_usage_quotas tool to retrieve information about your current subscription and remaining credits directly from the platform.
How does CrewAI discover and connect to MCP tools?
CrewAI connects to MCP servers lazily. when the crew starts, each agent resolves its MCP URLs and fetches the tool catalog via the standard tools/list method. This means tools are always fresh and reflect the server's current capabilities. No tool schemas need to be hardcoded.
Can different agents in the same crew use different MCP servers?
Yes. Each agent has its own mcps list, so you can assign specific servers to specific roles. For example, a reconnaissance agent might use a domain intelligence server while an analysis agent uses a vulnerability database server.
What happens when an MCP tool call fails during a crew run?
CrewAI wraps tool failures as context for the agent. The LLM receives the error message and can decide to retry with different parameters, fall back to a different tool, or mark the task as partially complete. This resilience is critical for production workflows.
Can CrewAI agents call multiple MCP tools in parallel?
CrewAI agents execute tool calls sequentially within a single reasoning step. However, you can run multiple agents in parallel using process=Process.parallel, each calling different MCP tools concurrently. This is ideal for workflows where separate data sources need to be queried simultaneously.
Can I run CrewAI crews on a schedule (cron)?
Yes. CrewAI crews are standard Python scripts, so you can invoke them via cron, Airflow, Celery, or any task scheduler. The crew.kickoff() method runs synchronously by default, making it straightforward to integrate into existing pipelines.
MCP tools not discovered
Ensure the Edge URL is correct. CrewAI connects lazily when the crew starts. check console output.
Agent not using tools
Make the task description specific. Instead of "do something", say "Use the available tools to list contacts".
Timeout errors
CrewAI has a 10s connection timeout by default. Ensure your network can reach the Edge URL.
Rate limiting or 429 errors
Vinkius enforces per-token rate limits. Check your subscription tier and request quota in the dashboard. Upgrade if you need higher throughput.
Explore More MCP Servers
View all →
JWT Decoder & Verifier
1 toolsDecode and mathematically verify JWT tokens local. Ensure API authentication tokens are cryptographically authentic and not expired.
Fortnite Cosmetics & Item Shop
8 toolsThe definitive server for Fortnite cosmetics — track daily shop rotations, leaked skins, and rarity via AI.
Eurostat Environment — EU Green Data
6 toolsEU environmental and energy data: greenhouse gas emissions by sector, complete energy balance sheets, electricity and gas prices, renewable energy share, waste statistics, and agricultural production for all 27 EU member states.
AT&T Messaging
9 toolsCPaaS Messaging -- Send SMS/MMS, manage shortcodes, track delivery status, and run bulk campaigns via AT&T Messaging API.