Spider Connector for AI agents.
3 live capabilities
Perform high-speed web scraping and data extraction at scale.
Waiting for input…
Why people use Spider
Spider Web Scraping for Large Scale Data Extraction
With this Connector, your agent does the heavy lifting for you. It can visit a site, handle the JavaScript, and pull the data into a clean format without you ever touching a browser. You get a clean dataset ready for analysis in seconds.
What Vinkius changes
Your agent gets high-speed web access without the usual technical headaches.
Use it from Claude, ChatGPT, Cursor or another AI client you already have.
One account · 5,900+ Connectors
- Real-world use case 01
Competitor Price Tracking
An analyst asks the agent to find all products on a rival's site and list their current prices in a table.
- Real-world use case 02
Documentation Summarization
A developer wants to understand a new library and asks the agent to crawl the entire docs site.
- Real-world use case 03
Lead Generation
A sales lead asks the agent to search for specific companies and scrape their About Us pages for contact info.
Complete set · 3capabilities
The complete Spider capability set.
These are the exact actions your AI can choose when you ask it to work with Spider.
01—03
3 capabilities in this set.
Part of 3 available through Spider.
- 01 Capability
Spider scrape
Fetch a specific URL and turn it into clean Markdown or HTML. It handles JavaScript and proxy rotation automatically.
- 02 Capability
Spider search
Combine web searching and data extraction in a single request. This saves time by finding and grabbing content simultaneously.
- 03 Capability
Spider crawl
Follow internal links to map out and scrape an entire website. It handles the recursion and depth limits for you.
Set up in minutes
One URL. Then ask Spider to work.
Claude and ChatGPT only need the Connector URL. Copy it once, add it in settings, and use Spider from the conversation.
Choose your client
Live previewAdvanced clients IDE · CLI
Claude · Web + desktop
Connector URL · ready to paste
Streamable HTTPhttps://edge.vinkius.com/vk_preview_HkRQy811uAcIjdwDKzB8QPk0TYPSWj05dtnMKf3x/mcp - Step 01
Open Connectors
In Claude Web or Claude Desktop, open Settings and choose Connectors.
- Step 02
Add the URL
Choose Add custom connector, name it Spider, and paste the URL above.
- Step 03
Turn it on in chat
Select +, open Connectors, and enable Spider for the conversation.
ChatGPT · Web + desktop
Connector URL · ready to paste
Streamable HTTPhttps://edge.vinkius.com/vk_preview_HkRQy811uAcIjdwDKzB8QPk0TYPSWj05dtnMKf3x/mcp - Step 01
Open MCP settings
On desktop, open Settings and MCP servers. On web, open your workspace app or connector settings.
- Step 02
Add the URL
Choose Add server with Streamable HTTP, or create a custom MCP app, then paste the Spider URL.
- Step 03
Save and start
Save the connection and enable Spider in your conversation. Desktop may ask you to restart once.
Cursor · IDE configuration
Advanced setup
{
"mcpServers": {
"spider": {
"url": "https://edge.vinkius.com/vk_preview_HkRQy811uAcIjdwDKzB8QPk0TYPSWj05dtnMKf3x/mcp"
}
}
}- Step 01
Open MCP Settings
Press Cmd+Shift+P (macOS) or Ctrl+Shift+P (Windows/Linux) → search "MCP Settings"
- Step 02
Add the server config
Paste the JSON configuration above into the mcp.json file that opens
- Step 03
Save the file
Cursor will automatically detect the new Connector
- Step 04
Start using Spider
Open Agent mode in chat and ask: "Using Spider, help me...". 3 tools available
VS Code Copilot · IDE configuration
Advanced setup
{
"mcpServers": {
"spider": {
"url": "https://edge.vinkius.com/vk_preview_HkRQy811uAcIjdwDKzB8QPk0TYPSWj05dtnMKf3x/mcp"
}
}
}- Step 01
Create MCP config
Create a .vscode/mcp.json file in your project root
- Step 02
Add the server config
Paste the JSON configuration above
- Step 03
Enable Agent mode
Open GitHub Copilot Chat and switch to Agent mode using the dropdown
- Step 04
Start using Spider
Ask Copilot: "Using Spider, help me...". 3 tools available
Windsurf · IDE configuration
Advanced setup
{
"mcpServers": {
"spider": {
"url": "https://edge.vinkius.com/vk_preview_HkRQy811uAcIjdwDKzB8QPk0TYPSWj05dtnMKf3x/mcp"
}
}
}- Step 01
Open MCP Settings
Go to Settings → MCP Configuration or press Cmd+Shift+P and search "MCP"
- Step 02
Add the server
Paste the JSON configuration above into mcp_config.json
- Step 03
Save and reload
Windsurf will detect the new server automatically
- Step 04
Start using Spider
Open Cascade and ask: "Using Spider, help me...". 3 tools available
Cline · IDE configuration
Advanced setup
{
"mcpServers": {
"spider": {
"url": "https://edge.vinkius.com/vk_preview_HkRQy811uAcIjdwDKzB8QPk0TYPSWj05dtnMKf3x/mcp"
}
}
}- Step 01
Open Cline MCP Settings
Click the Connectors icon in the Cline sidebar panel
- Step 02
Add remote server
Click "Add Connector" and paste the configuration above
- Step 03
Enable the server
Toggle the server switch to ON
- Step 04
Start using Spider
Ask Cline: "Using Spider, help me...". 3 tools available
Claude Code · Terminal command
Advanced setup
claude mcp add spider --transport http "https://edge.vinkius.com/vk_preview_HkRQy811uAcIjdwDKzB8QPk0TYPSWj05dtnMKf3x/mcp"- Step 01
Install Claude Code
Run npm install -g @anthropic-ai/claude-code if not already installed
- Step 02
Add the Connector
Run the command above in your terminal
- Step 03
Verify the connection
Run claude mcp to list connected servers, or type /mcp inside a session
- Step 04
Start using Spider
Ask Claude: "Using Spider, show me...". 3 tools are ready
Where the request belongs
Work Spider can move forward.
The data engineer who needs to ingest thousands of pages into a database without getting blocked. The researcher who wants to summarize entire websites in minutes. The content marketer looking for real-time competitive data.
Data Engineer
Pulls large datasets from complex websites into internal systems to feed data pipelines.
Market Researcher
Scrapes competitor pricing and reviews at scale to build market reports.
Content Strategist
Monitors news and trends across multiple domains to inform content calendars.
Build the capability set
Add more capabilities.
Each Connector adds new actions and data without changing how you work.
Browse ConnectorsScrapingBee
Powerful web scraping with JS rendering, premium proxies, and AI-powered data extraction directly from your AI agent.
Olostep
Scrape web pages at scale with a headless browser API that renders JavaScript and returns clean structured data instantly.
Crawlbase
Scrape and crawl via Crawlbase. perform HTML extraction, handle JS-rendered pages, bypass CAPTCHAs, and scrape social profiles directly from any AI agent.
Nimbleway
Web data collection and scraping via Nimbleway. extract content and search the web directly from your AI agent.
Scrapfly
Scrape web data at scale with a managed API that handles proxies, browser rendering, and anti-bot bypassing automatically.
ZenRows
Scrape HTML, bypass anti-bots, and extract structured data using ZenRows' advanced proxy and browser network.
Bring your own AI
Change the model, client or framework. Keep Spider connected.
-
Claude -
ChatGPT -
Gemini -
Cursor -
VS Code -
Windsurf -
ZCode -
Cline -
Zed -
Continue -
Kiro -
Roo Code -
Zencoder -
Goose -
Void -
Augment Code -
Amp -
Qodo -
Tabnine -
Pieces -
Sourcegraph Cody -
JetBrains -
Warp -
Amazon Q -
Antigravity -
BoltAI -
Raycast -
Jan -
LM Studio -
AnythingLLM -
Open WebUI -
Msty -
Cherry Studio -
LibreChat -
TypingMind -
Chorus -
5ire -
n8n -
LangChain -
LlamaIndex -
CrewAI -
Vercel AI SDK
Before you connect
Questions about Spider.
The practical details behind the request, access and result.
Can the Spider MCP handle websites that use a lot of JavaScript?
Yes, it handles JavaScript rendering automatically. This means your agent can see and extract content from dynamic pages that wouldn't show up with a basic scraper.
How does the Spider MCP deal with websites that block bots?
It uses built-in stealth mode, proxy rotation, and fingerprint rotation. This helps your agent stay undetected and prevents common blocks like CAPTCHAs.
Can I use the Spider MCP to crawl an entire website at once?
Yes, the Connector is designed for recursive crawling. It can follow internal links to map out and scrape every page on a domain at high speed.
Does the Spider MCP support different output formats like Markdown?
It supports multiple formats, including Markdown, HTML, and plain text. Markdown is the default because it's the easiest for your agent to read.
Is the Spider MCP fast enough for large-scale data mining?
It is built on a Rust engine designed for performance. It can handle speeds exceeding 100K pages per second, making it ideal for large-scale tasks.
How does the Spider MCP handle searching the web for data?
It combines search and scraping into one step. Your agent can search for a topic and get the content from the results immediately without extra steps.
How is Spider different from Firecrawl?
Spider is built in Rust and optimized for raw speed and volume. it can crawl 100K+ pages per second, making it 10-20x faster than Firecrawl for large-scale operations. Spider also offers lower per-page costs at high volume, built-in stealth mode with fingerprint rotation, and multiple request modes (HTTP, Smart, Chrome). Firecrawl excels at simplicity and LLM-specific features like JSON extraction.
What output formats does Spider support?
Spider supports Markdown, HTML, raw HTML, plain text, JSON (structured extraction), screenshots, and PDF output. You can specify the desired format via the return_format parameter in each request.
How does Spider pricing work?
Spider offers 500 free credits to get started (no credit card required). Paid plans are usage-based with credits consumed per page scraped. The Starter plan begins at $15/month with 12,000 credits. Enterprise plans offer custom pricing with dedicated infrastructure and unlimited concurrency.
One connection away
Give your agent a direct line to Spider.
Connect Spider once. Keep it beside 5,900+ managed Connectors when the next task needs more.
Explore every Connector No credit card required · Free tier available