Do I need an API key to use this MCP?

No, there are no API keys or external authentication required to use this capability.

How does it handle messy websites?

It uses Mozilla Readability logic to strip out ads, navbars, and boilerplate, leaving only the clean text.

Can my agent crawl multiple pages at once?

Yes, you can use the batch_read capability to fetch up to 10 different URLs in parallel.

What happens if I want to search for something new?

You can use the search capability to find matching URLs, titles, and snippets across the web.

Is it compatible with my existing AI capabilities?

Yes, it works with any MCP-compatible client including Claude, Cursor, Windsurf, and VS Code.

Can it read documentation sites that are split into multiple pages?

Yes! You can use the crawl capability. For example: 'Crawl the getting started guide at https://example.com/docs'. The agent will fetch the starting page and automatically follow inner links to gather up to 10 pages of context.

How does it handle ads and cluttered websites?

The read capability uses the same underlying technology as Firefox's 'Reader View' (@mozilla/readability). It intelligently strips out standard website boilerplate—like navbars, sidebars, footers, and ads—leaving only the title and the clean main article text converted to Markdown.

Is there a limit on how many URLs I can batch process?

Yes, to ensure conversational AI latency remains reasonable, the batch_read capability accepts a maximum of 10 URLs in a single request. All 10 URLs are fetched simultaneously in parallel for maximum speed.

An astronaut overseeing a futuristic data hub

Download PDF Markdown Version

Connect Web Scraper to ChatGPT, Claude and Gemini

Set it up once and it works in ChatGPT, Claude, Cursor, and any other client you love. It all runs safely in the background, so you can relax and focus on what really matters. Stop hallucinations by letting your agent read real websites.

Ask AI about this Connector

Developed, maintained, and hosted by Vinkius.

MCP VERIFIED · PRODUCTION READY · VINKIUS GUARANTEED

Waiting for input…

Works with modern AI clients that support MCP, including ChatGPT, Claude, Cursor, and more.

Your AI does the work. We keep it safe and sound.

No other AI tool gives you this. Your workflow runs in the client you already love, your account stays protected, and you decide what the agent can and cannot do. It is the whole reason to make the switch.

Each Connector lives inside our infrastructure, the same place where your workflow runs. The three things below are already part of it, working quietly in the background so you never have to think about them. Nothing to add, nothing to set up, nothing to worry about.

V8 Isolate01

Each Connector runs inside its own sealed environment.

Each Connector runs inside its own sealed V8 runtime — no access to your files, your system, or other servers. A Connector never sees past its own request.

Kill Switch02

One switch stops every agent. Instantly.

One action deactivates every Connector, revokes every token, and ends every session at once. AI Governance keeps the record.

FinOps per User03

Spending limits that pause instead of surprise.

Every user keeps their own connections and credentials, isolated from everyone else. Anything that would cross your spending limit is held for your approval, not billed.

Three controls, built into the layer your AI connects through.

Curated set · 8 capabilities

We ship only the actions that matter.

Capability set01 / 02

01-04

4 capabilities in this set.

Part of 8 available through Web Scraper.

01
Read
This capability reads a single webpage and returns its content. Use batch_read if you need to pull multiple pages at once.
02
Extract
This capability pulls metadata like titles, descriptions, OG tags, and author info from a URL.
03
Crawl
This capability follows links to crawl a website starting from a specific URL, returning up to 10 pages of content.
04
Read JSON
This capability fetches and returns raw JSON data from a provided URL.

Capability set02 / 02

05-08

4 capabilities in this set.

Part of 8 available through Web Scraper.

05
Extract jsonld
This capability targets and pulls JSON-LD structured data from a webpage.
06
Batch read
This capability reads multiple different URLs in a single call to save time.
07
List links
This capability scans a page and returns a list of all outbound hyperlinks found.
08
Search
This capability searches the web and returns matching URLs, titles, and text snippets.

Real work

What teams actually run

Technical Documentation

Point your agent to a library's docs to ensure it writes code using current versions.

Content Synthesis

Drop several Wikipedia or news links and have the agent create a unified report.

SEO Auditing

Ask the agent to check a site's OG tags and canonical links for optimization.

Data Extraction

Pull raw JSON or structured data from web endpoints for analysis.

Automate a task

Put Web Scraper to work on one thing.

Step-by-step automations your AI runs through this Connector: the workflow, the prompts to start with, and the exact capabilities behind each move.

One connector, every AI

Web Scraper works with the most popular AI clients.

These are the most popular clients, each with a step-by-step guide: one link, set up once, with governance and visibility built in. And because everything runs on the MCP standard, the same connection also works in any other compatible client — nothing to rebuild.

Building your own app? The connector is yours to use.

You don't need a client to put Web Scraper to work: the same hosted connection plugs into your own applications and agent code, with the same governance on every request. Build with it, chat with it — one connection for both.

Observed, not estimated

1663ms average. Fast in production.

Web Scraper is checked daily against the live service.

Daily averagePeak 1824ms

Oct 14Today

Fastest day: 1366ms
Slowest day: 1824ms
14-day trend: Improving-8%

Connect your client

One URL. Every client.

Activate the Connector, copy your link, and paste it into the client you already use. 8 capabilities arrive ready to run.

Preview access · not provider authentication

The vk_preview_* token belongs to Vinkius preview infrastructure. It lets Claude discover and display the capabilities of Web Scraper, so you can see the experience inside your AI.

It does not authenticate your account with Web Scraper. Actions requiring credentials or live account data may not run until you activate the Connector and authorize the service.

Web Scraper Connector

You're all set. Choose your MCP client and follow the setup instructions.

Connector linkhttps://edge.vinkius.com/vk_preview_YmTaAx3VdeRzHJqckaOgMTVnBzECnxTL8z7QeMgb/mcp

Claude Desktop

Follow the steps below to connect in seconds.

1In Claude Desktop, open Settings → Connectors.
2Click “Add custom connector” and paste the connector link above as the remote MCP server URL.
3Click Add and start a new chat — Web Scraper capabilities are ready to use.

Configuration · claude_desktop_config.jsonCopy

{
  "mcpServers": {
    "web-scraper-mcp": {
      "url": "https://edge.vinkius.com/vk_preview_YmTaAx3VdeRzHJqckaOgMTVnBzECnxTL8z7QeMgb/mcp"
    }
  }
}

Claude
ChatGPT
Cursor
VS Code
Windsurf
Claude Code
JetBrains
Cline

Step-by-step instructions for each client are in the guide. How to connect

Guided setup for Claude? Set up Web Scraper in Claude and other AIs

See all the AI clients this connector works with ↑

Who it's for

Built for the work Web Scraper owners hand off.

This MCP is built for anyone who needs their AI agent to interact with the live web instead of relying on static training data.

01
Developers
They point the agent to new API documentation to generate code using the latest syntax.
02
Researchers
They provide multiple URLs and have the agent synthesize data into summaries.
03
SEO Specialists
They use the agent to audit metadata and outbound link structures on specific pages.

FAQ

Questions Web Scraper owners ask.

01
Do I need an API key to use this MCP?
No, there are no API keys or external authentication required to use this capability.
02
How does it handle messy websites?
It uses Mozilla Readability logic to strip out ads, navbars, and boilerplate, leaving only the clean text.
03
Can my agent crawl multiple pages at once?
Yes, you can use the batch_read capability to fetch up to 10 different URLs in parallel.
04
What happens if I want to search for something new?
You can use the search capability to find matching URLs, titles, and snippets across the web.
05
Is it compatible with my existing AI capabilities?
Yes, it works with any MCP-compatible client including Claude, Cursor, Windsurf, and VS Code.
06
Can it read documentation sites that are split into multiple pages?
Yes! You can use the crawl capability. For example: 'Crawl the getting started guide at https://example.com/docs'. The agent will fetch the starting page and automatically follow inner links to gather up to 10 pages of context.
07
How does it handle ads and cluttered websites?
The read capability uses the same underlying technology as Firefox's 'Reader View' (@mozilla/readability). It intelligently strips out standard website boilerplate—like navbars, sidebars, footers, and ads—leaving only the title and the clean main article text converted to Markdown.
08
Is there a limit on how many URLs I can batch process?
Yes, to ensure conversational AI latency remains reasonable, the batch_read capability accepts a maximum of 10 URLs in a single request. All 10 URLs are fetched simultaneously in parallel for maximum speed.

Explore

More in Developer Tools

Connect Web Scraper to Claude, Cursor, ChatGPT & more

Your AI does the work. We keep it safe and sound.

Each Connector runs inside its own sealed environment.

One switch stops every agent. Instantly.

Spending limits that pause instead of surprise.

We ship only the actions that matter.

01-04

Read

Extract

Crawl

Read JSON

05-08

Extract jsonld

Batch read

List links

Search

What teams actually run

Technical Documentation

Content Synthesis

SEO Auditing

Data Extraction

Building your own app? The connector is yours to use.

Web Scraper Connector

Claude Desktop

Developers

Researchers

SEO Specialists

Do I need an API key to use this MCP?

How does it handle messy websites?

Can my agent crawl multiple pages at once?

What happens if I want to search for something new?

Is it compatible with my existing AI capabilities?

Can it read documentation sites that are split into multiple pages?

How does it handle ads and cluttered websites?

Is there a limit on how many URLs I can batch process?

Import.io (Web Data Extraction) AI Connector

Firecrawl AI Connector

Jina AI AI Connector

HTML to Markdown Converter AI Connector

Suggestions

Bing Search AI Connector

Data Pipeline Prover AI Connector

Grepsr AI Connector

Scale SERP AI Connector