How to Use the Browse AI MCP in CrewAI
Deploy a crew of specialized CrewAI agents to scrape, monitor, and analyze web data autonomously with Browse AI.
Works with every AI agent you already use
…and any MCP-compatible client
Connect Browse AI MCP to CrewAI
Create your Vinkius account to connect Browse AI to CrewAI and route execution through our secure gateway. The platform manages server hosting, runtime updates, and security layers. Configuration requires no manual server provisioning.
Multi-Agent Scraping Pipelines in CrewAI
Assign one agent to find the right scraper while another executes it using this MCP Server. Your researcher agent calls `list_robots` to find the correct tool, then passes the ID to your execution agent. The execution agent starts the extraction by calling `trigger_robot_run`. This division of labor keeps your autonomous operations organized and prevents single-agent bottlenecks.
Autonomous Scraper Performance Auditing
Let a manager agent oversee your scraping history. The auditor agent calls `list_robot_history` to pull past execution logs and identify patterns in failed runs. If a specific scraper keeps failing, the agent checks `get_robot_details` to see if the target website changed its layout. This lets your crew flag broken scrapers before they disrupt your business.
Self-Managing Scraping Schedules via MCP Server
Your crew can scale your monitoring operations up or down based on data needs. An operations agent checks active schedules using `list_active_monitors` to see what is currently running. If a tracking task is no longer needed, the agent removes the schedule. If a new competitor site needs tracking, it calls `create_monitor` to start tracking it automatically.
Set up Browse AI MCP in CrewAI
Prerequisites
- Python 3.10+ installed
-
crewaipackage (pip install crewai) - Active Vinkius subscription with a valid endpoint token
- 1
Install CrewAI
Run
pip install crewaito install the framework. MCP support is built-in via themcpsparameter. - 2
Add the MCP URL to your agent
Pass your Vinkius endpoint directly to the
mcpslist. Replace[YOUR_TOKEN_HERE]with your token from cloud.vinkius.com. CrewAI handles tool discovery and caching automatically. - 3
Kick off your crew
Create a
Crewwith your agent and tasks. Callcrew.kickoff()— the agent will automatically invoke Browse AI tools as needed.
from crewai import Agent, Task, Crew
agent = Agent(
role="Browse AI Analyst",
goal="Access and analyze Browse AI data via MCP.",
backstory="Expert analyst with direct Browse AI access.",
mcps=[
"https://edge.vinkius.com/[YOUR_TOKEN_HERE]/mcp"
],
)
task = Task(
description="List recent Browse AI transactions",
agent=agent,
expected_output="A summary of recent activity",
)
crew = Crew(agents=[agent], tasks=[task])
result = crew.kickoff()
print(result) Prerequisites
- Python 3.10+ installed
-
crewai+crewai-toolspackages - Active Vinkius subscription with a valid endpoint token
- 1
Install dependencies
Run
pip install crewai crewai-tools. TheMCPServerAdapterhandles lifecycle management and tool conversion. - 2
Connect with MCPServerAdapter
Use
MCPServerAdapteras a context manager withSseServerParameterspointing to your Vinkius endpoint. The adapter automatically manages connection lifecycle. - 3
Assign tools and run
Pass the returned
mcp_toolsto your agent'stoolsparameter. The adapter converts MCP tools to nativeBaseToolobjects compatible with all CrewAI agents.
from crewai import Agent, Task, Crew
from crewai_tools import MCPServerAdapter
from mcp import SseServerParameters
server_params = SseServerParameters(
url="https://edge.vinkius.com/[YOUR_TOKEN_HERE]/mcp"
)
with MCPServerAdapter(server_params) as mcp_tools:
agent = Agent(
role="Browse AI Analyst",
goal="Access and analyze Browse AI data via MCP.",
backstory="Expert analyst with direct Browse AI access.",
tools=mcp_tools,
)
task = Task(
description="List recent Browse AI transactions",
agent=agent,
expected_output="A summary of recent activity",
)
crew = Crew(agents=[agent], tasks=[task])
result = crew.kickoff()
print(result) Independent Platform Disclaimer: Vinkius is an independent platform and is not affiliated with, endorsed by, sponsored by, verified by, or otherwise authorized by Browse AI. All third-party trademarks, logos, and brand names are the property of their respective owners. Their use on this website is strictly for informational purposes to identify service compatibility and interoperability.
Why Choose Vinkius
Vinkius connects your tools to AI with real-time monitoring and automatic cost savings — all from one dashboard.
Real-time monitoring
Live
visibility into every interaction
Connect your favorite tools to your AI and see exactly what's happening — every request, every response, in real time.
Built-in savings
60%
lower AI costs
Vinkius compresses data between your apps and your AI automatically. Lower bills every month — no configuration required.
Single dashboard
One
place for every integration
Every tool your AI connects to, managed from a single screen. One account, complete control.
Common questions about Browse AI MCP in CrewAI
Use it with your favorite AI tools
Connect this server to Cursor, Claude, VS Code, and more.
Start using the Browse AI MCP today
We host it, we monitor it, we maintain it. You just paste one token.