WebScrapingAPI Connector for AI agents.
10 live capabilities
Extract structured data from websites and search engines without getting blocked.
Waiting for input…
Why people use WebScrapingAPI
WebScrapingAPI for Bypassing Bot Detection and Captchas
This Connector removes those hurdles. It gives your agent the ability to act like a real user browsing the web. You just tell the agent what you want, and it handles the proxies, the browser rendering, and the data extraction. You get a clean JSON object or a full HTML dump without the manual labor.
What Vinkius changes
You get high-quality web data without managing any infrastructure.
Use it from Claude, ChatGPT, Cursor or another AI client you already have.
One account · 5,900+ Connectors
- Real-world use case 01
Competitor Price Tracking
An e-commerce manager asks the agent to check prices on Amazon daily.
- Real-world use case 02
SEO Ranking Audit
An SEO specialist asks for Google rankings in three different countries.
- Real-world use case 03
ML Dataset Collection
A data scientist needs thousands of news headlines.
Complete set · 10capabilities
The complete WebScrapingAPI capability set.
These are the exact actions your AI can choose when you ask it to work with WebScrapingAPI.
01—04
4 capabilities in this set.
Part of 10 available through WebScrapingAPI.
- 01 Capability
Custom api scrape
Run a scrape with specific headers, geo-targeting, and wait times. This is useful for precise, localized data gathering.
- 02 Capability
Scrape and auto extract
Pull data from news or product pages and get it in a structured format automatically. It removes the need for manual selectors.
- 03 Capability
Scrape ecommerce product
Get prices, titles, and reviews from Amazon or Walmart as a JSON object. This simplifies price monitoring for retail sites.
- 04 Capability
Scrape static html
Grab raw HTML from any URL using a standard datacenter proxy. This is the fastest way to get source code from simple pages.
05—07
3 capabilities in this set.
Part of 10 available through WebScrapingAPI.
- 05 Capability
Scrape js rendered
Use a headless browser to capture the full state of a dynamic web page. This is necessary for sites that use React or Vue.
- 06 Capability
Scrape as mobile
Emulate a mobile device to see how a site looks or behaves on phones. This helps with mobile-specific content verification.
- 07 Capability
Scrape via residential proxy
Use residential IPs to bypass the most aggressive bot detection. This is your best bet for scraping high-security websites.
08—10
3 capabilities in this set.
Part of 10 available through WebScrapingAPI.
- 08 Capability
Search bing serp
Get structured search results specifically from Bing. Use this to analyze search trends on the Bing platform.
- 09 Capability
Search google serp
Pull structured organic results and ads from Google. This helps you see exactly what appears in search results.
- 10 Capability
Search yandex serp
Retrieve structured search results from the Yandex engine. Use this for analyzing search data in specific regions.
Set up in minutes
One URL. Then ask WebScrapingAPI to work.
Claude and ChatGPT only need the Connector URL. Copy it once, add it in settings, and use WebScrapingAPI from the conversation.
Choose your client
Live previewAdvanced clients IDE · CLI
Claude · Web + desktop
Connector URL · ready to paste
Streamable HTTPhttps://edge.vinkius.com/vk_preview_ViraSWOUvJPv9ZsTRcY0QMZxrqOQDwQ6PRVHRLMc/mcp - Step 01
Open Connectors
In Claude Web or Claude Desktop, open Settings and choose Connectors.
- Step 02
Add the URL
Choose Add custom connector, name it WebScrapingAPI, and paste the URL above.
- Step 03
Turn it on in chat
Select +, open Connectors, and enable WebScrapingAPI for the conversation.
ChatGPT · Web + desktop
Connector URL · ready to paste
Streamable HTTPhttps://edge.vinkius.com/vk_preview_ViraSWOUvJPv9ZsTRcY0QMZxrqOQDwQ6PRVHRLMc/mcp - Step 01
Open MCP settings
On desktop, open Settings and MCP servers. On web, open your workspace app or connector settings.
- Step 02
Add the URL
Choose Add server with Streamable HTTP, or create a custom MCP app, then paste the WebScrapingAPI URL.
- Step 03
Save and start
Save the connection and enable WebScrapingAPI in your conversation. Desktop may ask you to restart once.
Cursor · IDE configuration
Advanced setup
{
"mcpServers": {
"webscrapingapi": {
"url": "https://edge.vinkius.com/vk_preview_ViraSWOUvJPv9ZsTRcY0QMZxrqOQDwQ6PRVHRLMc/mcp"
}
}
}- Step 01
Open MCP Settings
Press Cmd+Shift+P (macOS) or Ctrl+Shift+P (Windows/Linux) → search "MCP Settings"
- Step 02
Add the server config
Paste the JSON configuration above into the mcp.json file that opens
- Step 03
Save the file
Cursor will automatically detect the new Connector
- Step 04
Start using WebScrapingAPI
Open Agent mode in chat and ask: "Using WebScrapingAPI, help me...". 10 tools available
VS Code Copilot · IDE configuration
Advanced setup
{
"mcpServers": {
"webscrapingapi": {
"url": "https://edge.vinkius.com/vk_preview_ViraSWOUvJPv9ZsTRcY0QMZxrqOQDwQ6PRVHRLMc/mcp"
}
}
}- Step 01
Create MCP config
Create a .vscode/mcp.json file in your project root
- Step 02
Add the server config
Paste the JSON configuration above
- Step 03
Enable Agent mode
Open GitHub Copilot Chat and switch to Agent mode using the dropdown
- Step 04
Start using WebScrapingAPI
Ask Copilot: "Using WebScrapingAPI, help me...". 10 tools available
Windsurf · IDE configuration
Advanced setup
{
"mcpServers": {
"webscrapingapi": {
"url": "https://edge.vinkius.com/vk_preview_ViraSWOUvJPv9ZsTRcY0QMZxrqOQDwQ6PRVHRLMc/mcp"
}
}
}- Step 01
Open MCP Settings
Go to Settings → MCP Configuration or press Cmd+Shift+P and search "MCP"
- Step 02
Add the server
Paste the JSON configuration above into mcp_config.json
- Step 03
Save and reload
Windsurf will detect the new server automatically
- Step 04
Start using WebScrapingAPI
Open Cascade and ask: "Using WebScrapingAPI, help me...". 10 tools available
Cline · IDE configuration
Advanced setup
{
"mcpServers": {
"webscrapingapi": {
"url": "https://edge.vinkius.com/vk_preview_ViraSWOUvJPv9ZsTRcY0QMZxrqOQDwQ6PRVHRLMc/mcp"
}
}
}- Step 01
Open Cline MCP Settings
Click the Connectors icon in the Cline sidebar panel
- Step 02
Add remote server
Click "Add Connector" and paste the configuration above
- Step 03
Enable the server
Toggle the server switch to ON
- Step 04
Start using WebScrapingAPI
Ask Cline: "Using WebScrapingAPI, help me...". 10 tools available
Claude Code · Terminal command
Advanced setup
claude mcp add webscrapingapi --transport http "https://edge.vinkius.com/vk_preview_ViraSWOUvJPv9ZsTRcY0QMZxrqOQDwQ6PRVHRLMc/mcp"- Step 01
Install Claude Code
Run npm install -g @anthropic-ai/claude-code if not already installed
- Step 02
Add the Connector
Run the command above in your terminal
- Step 03
Verify the connection
Run claude mcp to list connected servers, or type /mcp inside a session
- Step 04
Start using WebScrapingAPI
Ask Claude: "Using WebScrapingAPI, show me...". 10 tools are ready
Where the request belongs
Work WebScrapingAPI can move forward.
For the data scientist who needs clean datasets without the proxy headache, or the e-commerce manager tired of manual price checking.
Data Scientist
Pulls large datasets for ML training via chat commands instead of writing custom scrapers.
E-commerce Manager
Monitors competitor pricing and product availability across multiple marketplaces automatically.
SEO Specialist
Tracks SERP rankings and analyzes search snippets from multiple engines and regions.
Build the capability set
Add more capabilities.
Each Connector adds new actions and data without changing how you work.
Browse ConnectorsOxylabs
Scrape any website via Oxylabs. extract Google SERPs, Amazon products, Bing and Yandex results, or any arbitrary URL with JS rendering from any AI agent.
Crawlbase
Scrape and crawl via Crawlbase. perform HTML extraction, handle JS-rendered pages, bypass CAPTCHAs, and scrape social profiles directly from any AI agent.
Olostep
Scrape web pages at scale with a headless browser API that renders JavaScript and returns clean structured data instantly.
ScraperAPI
Equip your AI agent with proxy rotation and headless browsers to extract HTML, Google SERPs, and Amazon data at scale.
ScrapingBee
Powerful web scraping with JS rendering, premium proxies, and AI-powered data extraction directly from your AI agent.
Zyte
Extract structured web data, perform browser automation, and fetch search engine results directly through the Zyte API.
Bring your own AI
Change the model, client or framework. Keep WebScrapingAPI connected.
-
Claude -
ChatGPT -
Gemini -
Cursor -
VS Code -
Windsurf -
ZCode -
Cline -
Zed -
Continue -
Kiro -
Roo Code -
Zencoder -
Goose -
Void -
Augment Code -
Amp -
Qodo -
Tabnine -
Pieces -
Sourcegraph Cody -
JetBrains -
Warp -
Amazon Q -
Antigravity -
BoltAI -
Raycast -
Jan -
LM Studio -
AnythingLLM -
Open WebUI -
Msty -
Cherry Studio -
LibreChat -
TypingMind -
Chorus -
5ire -
n8n -
LangChain -
LlamaIndex -
CrewAI -
Vercel AI SDK
Before you connect
Questions about WebScrapingAPI.
The practical details behind the request, access and result.
Can WebScrapingAPI handle sites that block bots?
Yes, it uses a massive network of residential and mobile proxies to stay anonymous and bypass most bot detection systems.
How does WebScrapingAPI handle JavaScript-heavy sites?
It uses a headless browser to render the full page state, ensuring your agent sees exactly what a human user would see.
Can I use WebScrapingAPI to get Amazon product data?
Yes, it includes a specific capability to pull prices, titles, and reviews from Amazon and Walmart into a clean JSON format.
Does WebScrapingAPI work for Bing or Yandex search results?
Yes, it provides structured search engine results for both Bing and Yandex, making it easy to analyze rankings.
Can WebScrapingAPI extract data from news articles automatically?
Yes, it has an auto-extraction feature that parses news pages into structured data so you don't have to deal with selectors.
Can I see how a website looks on a mobile phone?
Yes, the Connector can emulate a mobile device to return the HTML and content as it appears on a phone screen.
Can I scrape websites that heavily use JavaScript?
Yes. Use the scrape_js_rendered capability. It utilizes a headless browser to execute the JavaScript on the target page and returns the full rendered HTML, making it ideal for SPAs built with React, Vue, or Angular.
How do I get structured data from Google search results?
You can use the search_google_serp capability. Simply provide your search query, and WebScrapingAPI will return a structured JSON object containing organic results, titles, URLs, snippets, and even ads.
What if a website blocks standard scraping attempts?
Use the scrape_via_residential_proxy capability. This routes your request through real residential IP addresses, providing maximum anonymity and allowing you to bypass aggressive bot protection systems.
One connection away
Give your agent a direct line to WebScrapingAPI.
Connect WebScrapingAPI once. Keep it beside 5,900+ managed Connectors when the next task needs more.
Explore every Connector No credit card required · Free tier available