Use Web Scraper with your AI.
Connect your account once and let the AI you already use work with it, without building another integration. Equip your AI agent with the ability to search the web, read pages, extract metadata, and crawl sites as clean Markdown.
Developed, maintained, and hosted by Vinkius.
MCP VERIFIED · PRODUCTION READY · VINKIUS GUARANTEED
Waiting for input…
Works with modern AI clients that support MCP, including ChatGPT, Claude, Cursor, and more.
Complete set · 8 capabilities
The complete Web Scraper capability set.
These are the exact actions your AI can choose when you ask it to work with Web Scraper.
01-04
4 capabilities in this set.
Part of 8 available through Web Scraper.
- 01
Read
Example: {"url": "https://example.com"}. For multiple pages, use batch_read. Read a single web page and return its content
- 02
Extract
Example: {"url": "https://example.com"}. For full content, use read. Extract page metadata: title, description, OG tags, lang, author, and more
- 03
Crawl
Example: {"url": "https://docs.example.com", "max_pages": 5}. For a single page, use read. Crawl a website starting from a URL and return 2+ pages
- 04
Read JSON
Example: {"url": "https://api.example.com/data"}. Fetch and return raw JSON from a URL
05-08
4 capabilities in this set.
Part of 8 available through Web Scraper.
- 05
Extract jsonld
Org structured data from a page. Example: {"url": "https://example.com"}. Extract JSON-LD structured data from a page
- 06
Batch read
Example: {"url": ["https://a.com", "https://b.com"]}. For a single page, use read. Read multiple pages in one call
- 07
List links
Example: {"url": "https://example.com"}. Extract all links from a page
- 08
Search
Example: {"query": "mcp protocol specification", "site": "modelcontextprotocol.io"}. After searching, use read or batch_read on the returned URLs to fetch full content. Do not call in rapid loops. refine the query instead. Search the web and return matching URLs, titles, and snippets
Observed, not estimated
1440ms average. Fast in production.
Web Scraper is checked daily against the live service.
- Fastest day
- 1292ms
- Slowest day
- 1753ms
- 14-day trend
- Stable-3%
Connect your client
One URL. Every client.
Activate the Connector, copy your link, and paste it into the client you already use. 8 capabilities arrive ready to run.
Preview access · not provider authentication
The vk_preview_* token belongs to Vinkius preview infrastructure. It lets Claude discover and display the capabilities of Web Scraper, so you can see the experience inside your AI.
It does not authenticate your account with Web Scraper. Actions requiring credentials or live account data may not run until you activate the Connector and authorize the service.
Web Scraper Connector
You're all set. Choose your MCP client and follow the setup instructions.
https://edge.vinkius.com/vk_preview_YmTaAx3VdeRzHJqckaOgMTVnBzECnxTL8z7QeMgb/mcpClaude Desktop
Follow the steps below to connect in seconds.
- 1In Claude Desktop, open Settings → Connectors.
- 2Click “Add custom connector” and paste the connector link above as the remote MCP server URL.
- 3Click Add and start a new chat — Web Scraper capabilities are ready to use.
{
"mcpServers": {
"web-scraper-mcp": {
"url": "https://edge.vinkius.com/vk_preview_YmTaAx3VdeRzHJqckaOgMTVnBzECnxTL8z7QeMgb/mcp"
}
}
}
Claude
ChatGPT
Cursor
VS Code
Windsurf
Claude Code
JetBrains
Cline
Step-by-step instructions for each client are in the guide. How to connect
FAQ
Questions Web Scraper owners ask.
- 01
Can it read documentation sites that are split into multiple pages?
Yes! You can use the crawl capability. For example: 'Crawl the getting started guide at https://example.com/docs'. The agent will fetch the starting page and automatically follow inner links to gather up to 10 pages of context.
- 02
How does it handle ads and cluttered websites?
The read capability uses the same underlying technology as Firefox's 'Reader View' (@mozilla/readability). It intelligently strips out standard website boilerplate—like navbars, sidebars, footers, and ads—leaving only the title and the clean main article text converted to Markdown.
- 03
Is there a limit on how many URLs I can batch process?
Yes, to ensure conversational AI latency remains reasonable, the batch_read capability accepts a maximum of 10 URLs in a single request. All 10 URLs are fetched simultaneously in parallel for maximum speed.
Explore
More in Developer Tools
ScrapingAnt AI Connector
Extract web data reliably with rotating proxies, headless Chrome rendering, and CAPTCHA solving built into eve
ViewNimbleway AI Connector
Web data collection and scraping via Nimbleway — extract content and search the web directly from your AI agen
ViewOlostep AI Connector
Scrape web pages at scale with a headless browser API that renders JavaScript and returns clean structured dat
ViewScrapfly AI Connector
Scrape web data at scale with a managed API that handles proxies, browser rendering, and anti-bot bypassing au
View
Suggestions
WebScrapingAPI AI Connector
Scrape HTML, render JavaScript, and retrieve structured SERP data using WebScrapingAPI's high-proxy network.
ViewScrapingBee AI Connector
Scrape websites without getting blocked using headless browsers, proxy rotation, and JavaScript rendering hand
ViewJigsawStack AI Connector
Access a suite of AI utility APIs for web scraping, translation, OCR, and sentiment analysis in one developer-
ViewDiffbot AI Connector
Extract structured data from any web page using AI that understands content like a human and builds knowledge
View
