How to Use the Firecrawl Alternative MCP in OpenAI Agents SDK

Q: How do I handle long-running crawl jobs in my agent workflow?

Your agent should invoke crawlurl to get a job ID, then periodically poll getcrawlstatus while executing other tasks. You can also view active runs with listcrawljobs.

Clean markdown parsed straight into your OpenAI Agents SDK pipeline without managing complex scraping infra.

See Vinkius in Action

Works with every AI agent you already use

…and any MCP-compatible client

MCP Servers - Free for Subscribers

Connect Firecrawl Alternative MCP to OpenAI Agents SDK

Create your Vinkius account to connect Firecrawl Alternative to OpenAI Agents SDK and route execution through our secure gateway. The platform manages server hosting, runtime updates, and security layers. Configuration requires no manual server provisioning.

GDPR Free for Subscribers

Setup Firecrawl Alternative with OpenAI Agents SDK

Ask AI about this MCP

ChatGPT

Claude

Perplexity

Turn messy web pages into clean markdown

The `scrape_url` tool is the core of this Firecrawl Alternative MCP server, stripping away the visual noise of any website and serving clean markdown directly to your agent. Your OpenAI Agents SDK pipeline gets raw, structured text without the HTML junk that bloats your token usage. Instead of wasting money feeding headers and scripts to your LLMs, this tool handles the heavy lifting in our V8 sandbox. Just pass a URL and let your agent parse the clean output.

Map entire site structures instantly

The `map_website` tool discovers and maps the entire link architecture of a domain so your agent knows where to look. This is crucial for OpenAI Agents SDK setups that need to plan their crawl path before pulling raw data. You don't have to guess the page layout or feed dead links to your agents. Run this tool first, get the sitemap, and let your agent selectively target the exact pages that matter.

Manage large crawls without blocking

The `crawl_url` tool starts background scraping runs, allowing your agent to kick off massive data gathering jobs without hanging the execution thread. Your agent can monitor the progress using `get_crawl_status` and clean up finished tasks with `delete_crawl_job`. This asynchronous flow fits perfectly with the OpenAI Agents SDK guardrails and handoff systems. If a crawl takes too long, your specialized monitoring agent can check `list_crawl_jobs` to decide whether to wait or pivot.

Setup guide

Set up Firecrawl Alternative MCP in OpenAI Agents SDK

Prerequisites

Python 3.10+ installed
openai-agents package (pip install openai-agents)
Active Vinkius subscription with a valid endpoint token

1

Install the SDK

Run pip install openai-agents to install the OpenAI Agents SDK. The MCP integration is built-in — no extra dependencies needed.
2

Connect via SSE transport

Use MCPServerSse with your Vinkius endpoint URL. Replace [YOUR_TOKEN_HERE] with your token from cloud.vinkius.com. The SDK auto-discovers all Firecrawl Alternative tools at runtime.
3

Create your Agent

Pass the MCP to Agent(mcp_servers=[server]). The agent receives Firecrawl Alternative tools as native definitions — JSON schemas resolve automatically.
4

Run the agent

Call Runner.run(agent, prompt) to execute. The agent invokes the appropriate Firecrawl Alternative tools and returns structured results. Copy the full example on the right to get started.

agent.py

import asyncio
from agents import Agent, Runner
from agents.mcp import MCPServerSse

async def main():
    async with MCPServerSse(
        url="https://edge.vinkius.com/[YOUR_TOKEN_HERE]/mcp"
    ) as server:
        agent = Agent(
            name="Firecrawl Alternative Agent",
            instructions="You have access to Firecrawl Alternative tools.",
            mcp_servers=[server],
        )
        result = await Runner.run(agent, "List recent transactions")
        print(result.final_output)

asyncio.run(main())

Get your connection token →

Independent Platform Disclaimer: Vinkius is an independent platform and is not affiliated with, endorsed by, sponsored by, verified by, or otherwise authorized by Firecrawl. All third-party trademarks, logos, and brand names are the property of their respective owners. Their use on this website is strictly for informational purposes to identify service compatibility and interoperability.

Why Choose Vinkius

Vinkius connects your tools to AI with real-time monitoring and automatic cost savings — all from one dashboard.

Connect Firecrawl Alternative now

Real-time monitoring

Live

visibility into every interaction

Connect your favorite tools to your AI and see exactly what's happening — every request, every response, in real time.

Built-in savings

60%

lower AI costs

Vinkius compresses data between your apps and your AI automatically. Lower bills every month — no configuration required.

Single dashboard

One

place for every integration

Every tool your AI connects to, managed from a single screen. One account, complete control.

Common questions about Firecrawl Alternative MCP in OpenAI Agents SDK

You register the server using the MCPServerStreamableHttp class and pass it to your Agent constructor. The SDK automatically discovers the tools, letting your agent call them natively.

Yes, you can control tool access at the agent definition level. If you only want an agent to read single pages, expose only `scrape_url` and hide the crawling tools.

This server outputs clean, LLM-ready markdown directly to your agent's context window. It saves you from writing custom parsers or burning tokens on raw HTML.

Your agent should invoke `crawl_url` to get a job ID, then periodically poll `get_crawl_status` while executing other tasks. You can also view active runs with `list_crawl_jobs`.

All scraped HTML, target URLs, and crawl logs are processed in our isolated MCP sandboxes and sent straight to your agent. We never store your extracted page content or search queries on our servers.

Use it with your favorite AI tools

Connect this server to Cursor, Claude, VS Code, and more.

OpenAI Agents SDK sdk-python

Google ADK sdk-python

Pydantic AI sdk-python

Vercel AI SDK sdk-typescript