An astronaut overseeing a futuristic data hub
Download PDFMarkdown Version

Connect Crawlbase to ChatGPT, Claude and Gemini

Set it up once and it works in ChatGPT, Claude, Cursor, and any other client you love. It all runs safely in the background, so you can relax and focus on what really matters. Turn any website into structured data with a single prompt.

Ask AI about this Connector

Developed, maintained, and hosted by Vinkius.

MCP VERIFIED · PRODUCTION READY · VINKIUS GUARANTEED

Waiting for input…

Works with modern AI clients that support MCP, including ChatGPT, Claude, Cursor, and more.

ChatGPTClaudeCursorPerplexityGeminiMicrosoft CopilotRaycastMeta AI

Your AI does the work. We keep it safe and sound.

No other AI tool gives you this. Your workflow runs in the client you already love, your account stays protected, and you decide what the agent can and cannot do. It is the whole reason to make the switch.

Each Connector lives inside our infrastructure, the same place where your workflow runs. The three things below are already part of it, working quietly in the background so you never have to think about them. Nothing to add, nothing to set up, nothing to worry about.

A futuristic MCP client docking bay
V8 Isolate01

Each Connector runs inside its own sealed environment.

Each Connector runs inside its own sealed V8 runtime — no access to your files, your system, or other servers. A Connector never sees past its own request.

Kill Switch02

One switch stops every agent. Instantly.

One action deactivates every Connector, revokes every token, and ends every session at once. AI Governance keeps the record.

FinOps per User03

Spending limits that pause instead of surprise.

Every user keeps their own connections and credentials, isolated from everyone else. Anything that would cross your spending limit is held for your approval, not billed.

Three controls, built into the layer your AI connects through.

Curated set · 10 capabilities

We ship only the actions that matter.

Capability set01 / 03

01-04

4 capabilities in this set.

Part of 10 available through Crawlbase.

  1. 01

    Scrape amazon

    This capability pulls product data from Amazon while navigating e-commerce site constraints.

  2. 02

    Scrape google serp

    Use this to get search engine results directly from Google domains.

  3. 03

    Scrape linkedin

    This capability extracts structural data from LinkedIn profiles.

  4. 04

    Scrape twitter

    Fetch data from X (formerly Twitter) profiles using dedicated extraction logic.

Capability set02 / 03

05-07

3 capabilities in this set.

Part of 10 available through Crawlbase.

  1. 05

    Custom scrape

    This capability provisions custom proxies with specific headers for unique scraping needs.

  2. 06

    Get screenshot link

    Get a URL for a visual snapshot of any webpage.

  3. 07

    Scrape facebook

    This capability extracts data from Facebook social pages.

Capability set03 / 03

08-10

3 capabilities in this set.

Part of 10 available through Crawlbase.

  1. 08

    Scrape HTML

    Extract raw HTML content using Crawlbase datacenter proxies.

  2. 09

    Scrape js rendered

    This capability handles JavaScript rendering to access content in dynamic web apps.

  3. 10

    Scrape JSON format

    Convert web properties into a structured JSON format.

Real work

What teams actually run

01

Competitor Monitoring

Track price changes on Amazon products by having your agent scrape specific URLs periodically.

02

Lead Generation

Pull profile information from LinkedIn or X to build contact lists.

03

SEO Auditing

Analyze Google search engine results pages (SERPs) to see where specific keywords rank.

04

Site Verification

Use the screenshot capability to visually confirm that a page rendered correctly after a crawl.

Automate a task

Put Crawlbase to work on one thing.

Step-by-step automations your AI runs through this Connector: the workflow, the prompts to start with, and the exact capabilities behind each move.

One connector, every AI

Crawlbase works with the most popular AI clients.

These are the most popular clients, each with a step-by-step guide: one link, set up once, with governance and visibility built in. And because everything runs on the MCP standard, the same connection also works in any other compatible client — nothing to rebuild.

ClaudeClaudeChatGPTChatGPTGeminiGeminiPerplexityPerplexityGrokGrokMicrosoft CopilotMicrosoft CopilotCursorCursorVS CodeVS CodeWindsurfWindsurfJetBrainsJetBrainsClineClineLangChainLangChainVercel AI SDKVercel AI SDKLovableLovableZ.aiZ.aiRaycastRaycastQwen CodeQwen CodeKimi CodeKimi CodeLe ChatLe Chat

Building your own app? The connector is yours to use.

You don't need a client to put Crawlbase to work: the same hosted connection plugs into your own applications and agent code, with the same governance on every request. Build with it, chat with it — one connection for both.

Observed, not estimated

922ms average. Fast in production.

Crawlbase is checked daily against the live service.

Daily averagePeak 1211ms
Oct 3Today
Fastest day
770ms
Slowest day
1211ms
14-day trend
Slowing+5%

Connect your client

One URL. Every client.

Activate the Connector, copy your link, and paste it into the client you already use. 10 capabilities arrive ready to run.

Preview access · not provider authentication

The vk_preview_* token belongs to Vinkius preview infrastructure. It lets Claude discover and display the capabilities of Crawlbase, so you can see the experience inside your AI.

It does not authenticate your account with Crawlbase. Actions requiring credentials or live account data may not run until you activate the Connector and authorize the service.

Crawlbase Connector

You're all set. Choose your MCP client and follow the setup instructions.

Connector linkhttps://edge.vinkius.com/vk_preview_AcN0JE7lQv9RjbUnrxQnYlI9bigE4gxGmDTPSZBI/mcp

Claude Desktop

Follow the steps below to connect in seconds.

  1. 1In Claude Desktop, open Settings → Connectors.
  2. 2Click “Add custom connector” and paste the connector link above as the remote MCP server URL.
  3. 3Click Add and start a new chat — Crawlbase capabilities are ready to use.
Configuration · claude_desktop_config.jsonCopy
{
  "mcpServers": {
    "crawlbase-mcp": {
      "url": "https://edge.vinkius.com/vk_preview_AcN0JE7lQv9RjbUnrxQnYlI9bigE4gxGmDTPSZBI/mcp"
    }
  }
}
  • Claude
  • ChatGPT
  • Cursor
  • VS Code
  • Windsurf
  • Claude Code
  • JetBrains
  • Cline

Step-by-step instructions for each client are in the guide. How to connect

Guided setup for Claude? Set up Crawlbase in Claude and other AIs

See all the AI clients this connector works with ↑

Who it's for

Built for the work Crawlbase owners hand off.

This MCP is built for professionals who need to turn web content into actionable data without writing code.

  • 01

    Data Analysts

    They hand off the task of gathering structured web data and search results to the agent.

  • 02

    Growth Hackers

    They use the agent to monitor competitor pricing on Amazon or social activity on LinkedIn.

  • 03

    Developers

    They use the agent to test and debug web extraction logic through conversation.

  • 04

    Market Researchers

    They delegate deep web crawls and site snapshots to the agent for offline analysis.

FAQ

Questions Crawlbase owners ask.

  • 01

    How do I use Crawlbase with Claude?

    Once you connect the MCP to your Claude client via Vinkius, you can simply ask Claude to scrape a website or find information using the provided capabilities.

  • 02

    Does this MCP handle sites that use JavaScript?

    Yes, the scrape_js_rendered capability is specifically designed to handle sites that require JavaScript to display content.

  • 03

    Can I get data in JSON format?

    Yes, you can use the scrape_json_format capability to force the agent to extract specific properties into a structured JSON output.

  • 04

    What social media platforms are supported?

    The MCP includes dedicated capabilities for scraping LinkedIn, Facebook, and X (formerly Twitter).

  • 05

    Do I need to manage my own proxies?

    No, Crawlbase manages the proxies and handles CAPTCHA solving automatically through the MCP.

  • 06

    When should I use the JavaScript (JS) Token versus the Normal Token?

    Use the Normal Token for fast, static HTML extraction. Switch to the JavaScript Token when the target site uses frameworks like React or Angular, where content is rendered dynamically in the browser. The 'scrape_js_rendered' capability requires the JS Token to function.

  • 07

    Can my agent bypass CAPTCHAs while scraping Google or LinkedIn?

    Yes. Crawlbase is built to handle CAPTCHAs and blocks natively. When you use specialized capabilities like 'scrape_google_serp' or 'scrape_linkedin', the agent routes your requests through Crawlbase's advanced proxy infrastructure to ensure successful data extraction.

  • 08

    How do I get a structured JSON response instead of raw HTML?

    Use the 'scrape_json_format' capability or the specialized scraper capabilities (Amazon, LinkedIn, etc.). These trigger Crawlbase's auto-extraction pipelines, which analyze the page structure and return specific data fields in a clean JSON format.

Explore

More in Friends

Suggestions

Connect Crawlbase to Claude, Cursor, ChatGPT & more