How to Use the Crawlbase MCP in Cursor

Q: Can Cursor write scraping scripts using Crawlbase?

Yes. You can ask the agent to test a target using scrapehtml first. Once it sees the raw DOM structure, it writes the exact Python or Node.js code needed to parse that specific layout in your own application.

Feed live scraped data into Cursor. Write code against real DOMs and JSON payloads without leaving your editor.

See Vinkius in Action

Works with every AI agent you already use

…and any MCP-compatible client

MCP Servers - Free for Subscribers

Connect Crawlbase MCP to Cursor

Create your Vinkius account to connect Crawlbase to Cursor and route execution through our secure gateway. The platform manages server hosting, runtime updates, and security layers. Configuration requires no manual server provisioning.

GDPR Free for Subscribers

Setup Crawlbase with Cursor

Ask AI about this MCP

ChatGPT

Claude

Perplexity

Inject live JSON and search results into Cursor

`scrape_json_format` extracts specific properties from target endpoints and feeds them straight to your Cursor Agent. When you are writing a data parser, the AI uses real production structures instead of hallucinating mock payloads. For broader discovery, `scrape_google_serp` pulls active search engine result pages into your workspace. You ask the agent to find current API documentation links, and it pulls the exact URLs needed to write accurate implementation code.

Read social graphs via the Crawlbase MCP Server

`scrape_twitter` and `scrape_facebook` fetch mapped limits and active social pages directly into your active editor tab. You can instruct Cursor to build an analytics dashboard while it actively reads live profile structures to generate the correct types and interfaces. Professional profiles require different handling. The `scrape_linkedin` tool navigates specific blueprint constraints to return exact structural matches. The AI writes your integration logic based on the actual fields returned by the endpoint today, not outdated documentation.

Execute custom scrapes and verify layouts

`custom_scrape` provisions highly-available requests with custom proxy configurations. You tell Cursor what headers your target requires, and the agent executes the precise fetch command to test your scraper logic. Visual validation happens inline too. `get_screenshot_link` triggers an automated check of the target domain and returns the image URL. You review the rendered page state right in your terminal output before writing the CSS selectors to parse it.

Setup guide

Set up Crawlbase MCP in Cursor

Prerequisites

Cursor installed (macOS, Windows, or Linux)
Active Vinkius subscription with a valid endpoint token

1

Open MCP Settings

Go to Cursor Settings → MCP or open the Command Palette (Cmd+Shift+P / Ctrl+Shift+P) and search for "MCP: Add Server".
2

Add the Crawlbase MCP

Cursor will create or open .cursor/mcp.json in your project root. Paste the JSON snippet on the right. Replace [YOUR_TOKEN_HERE] with your endpoint token from cloud.vinkius.com.
3

Enable Agent mode

Open Composer (Cmd+I / Ctrl+I) and switch to Agent mode using the dropdown at the top. MCP tools are only available in Agent mode.
4

Verify the connection

Ask Cursor something like "List my recent Crawlbase transactions." If the MCP tools are loaded correctly, Cursor will call the Crawlbase tools automatically. You can also check Settings → MCP for a green status indicator.

.cursor/mcp.json

{
  "mcpServers": {
    "crawlbase-mcp": {
      "url": "https://edge.vinkius.com/[YOUR_TOKEN_HERE]/mcp"
    }
  }
}

Get your connection token →

Independent Platform Disclaimer: Vinkius is an independent platform and is not affiliated with, endorsed by, sponsored by, verified by, or otherwise authorized by Crawlbase. All third-party trademarks, logos, and brand names are the property of their respective owners. Their use on this website is strictly for informational purposes to identify service compatibility and interoperability.

Why Choose Vinkius

Vinkius connects your tools to AI with real-time monitoring and automatic cost savings — all from one dashboard.

Connect Crawlbase now

Real-time monitoring

Live

visibility into every interaction

Connect your favorite tools to your AI and see exactly what's happening — every request, every response, in real time.

Built-in savings

60%

lower AI costs

Vinkius compresses data between your apps and your AI automatically. Lower bills every month — no configuration required.

Single dashboard

One

place for every integration

Every tool your AI connects to, managed from a single screen. One account, complete control.

Common questions about Crawlbase MCP in Cursor

Create an mcp.json file in your project root directory. Add the Crawlbase server configuration, then toggle Agent mode on in your chat panel.

Yes. You can ask the agent to test a target using scrape_html first. Once it sees the raw DOM structure, it writes the exact Python or Node.js code needed to parse that specific layout in your own application.

The underlying engine handles proxy rotation and basic bot mitigation. When Cursor calls a tool like scrape_js_rendered, the server manages the browser fingerprinting required to return the actual page content.

Context switching breaks focus. Pulling a live SERP or Amazon product array directly into your IDE means the AI can instantly write TypeScript interfaces matching the actual response payload.

The server only sees the specific URLs, search queries, or ASINs you explicitly pass to the scraping tools. Vinkius isolates every MCP session in an ephemeral environment. Your proprietary source code never leaves the editor, and the extracted DOM nodes are destroyed immediately after delivery.

Use it with your favorite AI tools

Connect this server to Cursor, Claude, VS Code, and more.

OpenAI Agents SDK sdk-python

Google ADK sdk-python

Pydantic AI sdk-python

Vercel AI SDK sdk-typescript