How to Use the Browse AI MCP in CrewAI

Deploy specialized scraping crews in CrewAI using the Browse AI MCP Server for autonomous web intelligence.

See Vinkius in Action

Works with every AI agent you already use

…and any MCP-compatible client

MCP Servers - Free for Subscribers

Connect Browse AI MCP to CrewAI

Create your Vinkius account to connect Browse AI to CrewAI and route execution through our secure gateway. The platform manages server hosting, runtime updates, and security layers. Configuration requires no manual server provisioning.

GDPR Free for Subscribers

Setup Browse AI with CrewAI

Ask AI about this MCP

ChatGPT

Claude

Perplexity

Orchestrate scraping crews in CrewAI

Assign a dedicated agent to use `run_robot` while another agent processes the results. This division of labor keeps your CrewAI operations efficient and focused. Because the agents share memory, the analyzer agent always knows which task ID to check via `get_task`. It pulls the data immediately after the scraper finishes.

Manage robot fleets in CrewAI

Use `list_robots` to give your crew a menu of available scrapers. You can define specific roles, like a researcher agent that only uses certain robot IDs. `list_monitors` lets your moderator agent track the health of your scraping schedule. If a monitor fails, the agent can alert you or try to restart the process.

Audit extraction history in CrewAI

Your logging agent can call `list_bulk_runs` to keep a master record of all operations. This ensures your CrewAI setup maintains a clean history for reporting. Using `get_bulk_run` provides the details needed for your agents to calculate success rates. They can summarize this data and send you a daily report on extraction performance.

Setup guide

Set up Browse AI MCP in CrewAI

Prerequisites

Python 3.10+ installed
crewai package (pip install crewai)
Active Vinkius subscription with a valid endpoint token

1

Install CrewAI
Run pip install crewai to install the framework. MCP support is built-in via the mcps parameter.
2

Add the MCP URL to your agent
Pass your Vinkius endpoint directly to the mcps list. Replace [YOUR_TOKEN_HERE] with your token from cloud.vinkius.com. CrewAI handles tool discovery and caching automatically.
3

Kick off your crew
Create a Crew with your agent and tasks. Call crew.kickoff() — the agent will automatically invoke Browse AI tools as needed.

crew.py

from crewai import Agent, Task, Crew

agent = Agent(
    role="Browse AI Analyst",
    goal="Access and analyze Browse AI data via MCP.",
    backstory="Expert analyst with direct Browse AI access.",
    mcps=[
        "https://edge.vinkius.com/[YOUR_TOKEN_HERE]/mcp"
    ],
)

task = Task(
    description="List recent Browse AI transactions",
    agent=agent,
    expected_output="A summary of recent activity",
)

crew = Crew(agents=[agent], tasks=[task])
result = crew.kickoff()
print(result)

Get your connection token →

Prerequisites

Python 3.10+ installed
crewai + crewai-tools packages
Active Vinkius subscription with a valid endpoint token

1

Install dependencies
Run pip install crewai crewai-tools. The MCPServerAdapter handles lifecycle management and tool conversion.
2

Connect with MCPServerAdapter
Use MCPServerAdapter as a context manager with SseServerParameters pointing to your Vinkius endpoint. The adapter automatically manages connection lifecycle.
3

Assign tools and run
Pass the returned mcp_tools to your agent's tools parameter. The adapter converts MCP tools to native BaseTool objects compatible with all CrewAI agents.

crew.py

from crewai import Agent, Task, Crew
from crewai_tools import MCPServerAdapter
from mcp import SseServerParameters

server_params = SseServerParameters(
    url="https://edge.vinkius.com/[YOUR_TOKEN_HERE]/mcp"
)

with MCPServerAdapter(server_params) as mcp_tools:
    agent = Agent(
        role="Browse AI Analyst",
        goal="Access and analyze Browse AI data via MCP.",
        backstory="Expert analyst with direct Browse AI access.",
        tools=mcp_tools,
    )

    task = Task(
        description="List recent Browse AI transactions",
        agent=agent,
        expected_output="A summary of recent activity",
    )

    crew = Crew(agents=[agent], tasks=[task])
    result = crew.kickoff()
    print(result)

Get your connection token →

Independent Platform Disclaimer: Vinkius is an independent platform and is not affiliated with, endorsed by, sponsored by, verified by, or otherwise authorized by Browse AI. All third-party trademarks, logos, and brand names are the property of their respective owners. Their use on this website is strictly for informational purposes to identify service compatibility and interoperability.

Why Choose Vinkius

Vinkius connects your tools to AI with real-time monitoring and automatic cost savings — all from one dashboard.

Connect Browse AI now

Real-time monitoring

Live

visibility into every interaction

Connect your favorite tools to your AI and see exactly what's happening — every request, every response, in real time.

Built-in savings

60%

lower AI costs

Vinkius compresses data between your apps and your AI automatically. Lower bills every month — no configuration required.

Single dashboard

One

place for every integration

Every tool your AI connects to, managed from a single screen. One account, complete control.

Common questions about Browse AI MCP in CrewAI

Pass the Vinkius MCP server URL directly into your agent definition. CrewAI handles the transport, making the tools available to your specialized crew members.

Yes, you can use a tool filter to limit which agents have access to specific scrapers. This is perfect for keeping your agents specialized.

Data privacy is enforced at the Vinkius gateway. Each request is isolated, so your extracted web content is never visible to other users.

No, Vinkius handles all the auth. You just provide the endpoint, and the MCP Server manages the connection to your account.

Yes, they can trigger bulk runs and monitor their progress. The agents will poll the system status until the entire data set is ready.

Use it with your favorite AI tools

Connect this server to Cursor, Claude, VS Code, and more.