When should I use the JavaScript (JS) Token versus the Normal Token?

Use the Normal Token for fast, static HTML extraction. Switch to the JavaScript Token when the target site uses frameworks like React or Angular, where content is rendered dynamically in the browser. The 'scrape_js_rendered' tool requires the JS Token to function.

Can my agent bypass CAPTCHAs while scraping Google or LinkedIn?

Yes. Crawlbase is built to handle CAPTCHAs and blocks natively. When you use specialized tools like 'scrape_google_serp' or 'scrape_linkedin', the agent routes your requests through Crawlbase's advanced proxy infrastructure to ensure successful data extraction.

How do I get a structured JSON response instead of raw HTML?

Use the 'scrape_json_format' tool or the specialized scraper tools (Amazon, LinkedIn, etc.). These trigger Crawlbase's auto-extraction pipelines, which analyze the page structure and return specific data fields in a clean JSON format.

Crawlbase MCP Server

Name: Crawlbase
Availability: InStock
Author: Vinkius

crawlbase.com

Built by Vinkius GDPR ToolsFree

Scrape and crawl via Crawlbase — perform HTML extraction, handle JS-rendered pages, bypass CAPTCHAs, and scrape social profiles directly from any AI agent.

Vinkius AI Gateway supports streamable HTTP and SSE.

Works with every AI agent you already use

…and any MCP-compatible client

Crawlbase MCP Server: see your AI Agent in action

AI Agent→Vinkius→Crawlbase

You

Vinkius AI Gateway

GDPR·High Security·Kill Switch·Ultra-Low Latency·Plug and Play

Built-in capabilities (10)

custom_scrape

Provision a highly-available Request Payload generating Custom proxies

get_screenshot_link

Dispatch an automated validation check routing explicit Web Snapshot domains

scrape_amazon

Inspect deep internal arrays mitigating specific E-Commerce constraints

scrape_facebook

Enumerate explicitly attached structured rules exporting active Social Pages

scrape_google_serp

Identify precise active arrays spanning rented Context domains for Search

scrape_html

crawlbase.com` datacenter proxies. Identify bounded routing spaces inside the Headless Crawlbase Engine

scrape_js_rendered

Retrieve explicit Cloud logging tracing explicit Payload IDs limitlessly

scrape_json_format

Perform structural extraction of properties driving active Fields

scrape_linkedin

Retrieve the exact structural matching verifying Blueprint constraints

scrape_twitter

Fetch elaborate explicit mapped limits via Crawlbase X extraction

What this connector unlocks

Connect your Crawlbase (formerly ProxyCrawl) account to any AI agent and take full control of your web scraping and anonymous crawling workflows through natural conversation.

What you can do

Standard Scraper — Identify bounded routing spaces inside the headless engine to extract explicitly attached HTML content via datacenter proxies
JS Rendering — Discover disconnected physical limits tracking exactly what JS-rendered frames expose to extract exact single-page UI bounds
Structured JSON Extraction — Analyzes specific global bounds driving auto-extraction pipelines to force raw HTTP outputs into structured JSON format strictly
Screenshot Capture — Dispatch automated validation checks to generate valid proxy endpoints returning configured Crawlbase screenshot URLs
Specialized Scraping — Leverage dedicated algorithms for Amazon products, LinkedIn profiles, Facebook pages, and Twitter (X) graph profiles natively
Search Engine Discovery — Explain explicitly mapped proxy lists targeting Google domains to parse SERP limits and bypass CAPTCHAs limitlessly
Custom Proxy Management — Provision highly-available request payloads generating custom proxies with specific headers and crawling logic

How it works

1. Subscribe to this server
2. Enter your Crawlbase Normal Token and your optional JavaScript Token (found in your Crawlbase Dashboard)
3. Start scraping and crawling from Claude, Cursor, or any MCP-compatible client

Who is this for?

Data Analysts — extract structured web data and search engine results without writing complex scraping scripts
Growth Hackers — monitor competitor products on Amazon or social profiles on LinkedIn and Twitter in real-time
Developers — test and debug web extraction pipelines and JS-rendering logic through natural conversation
Market Researchers — perform deep web crawls and capture snapshots of target sites for offline analysis

Frequently asked questions

Give your AI agents the power of Crawlbase

Access Crawlbase and 2,000+ MCP servers — ready for your agents to use, right now. No glue code. No custom integrations. Just plug Vinkius AI Gateway and let your agents work.

DETAILS

CategoryFriends Mcp

Haystack (deepset Cloud)

7 tools

Build and manage AI-powered search and RAG pipelines via deepset Cloud — search documents, run pipelines, and manage workspaces.

Arize AI

10 tools

Automate LLM and ML observability via Arize — monitor models, track telemetry, run evaluations, and analyze data drift directly from any AI agent.

LlamaCloud (Managed RAG & Parsing)

6 tools

Manage RAG pipelines and document parsing via LlamaCloud — orchestrate LlamaParse jobs and audit data ingestion.

FanPower (PickUp)

12 tools

Drive fan engagement via FanPower (PickUp) — manage interactive questions, track fan picks, and monitor rewards directly through your AI agent.

BlazeMeter

10 tools

Automate continuous performance testing via BlazeMeter — manage workspaces, trigger load tests, and analyze active run metrics securely via AI.

Mercado Pago

12 tools

Process payments, generate Pix QR codes, manage customers and refunds via Mercado Pago API.