How to Use the WebScrapingAPI MCP in Claude Code

Q: How do I set up scheduled scraping jobs using WebScrapingAPI with Claude Code?

You would use the searchgoogleserp tool in a shell script. You run it headless, capture its structured JSON output via stdout, and pipe that data into your processing logic.

Q: What if I need to scrape dynamic content for my CI/CD?

Use scrapejsrendered. It executes the scraping job using a full headless browser environment. This ensures that JavaScript-loaded content is fully captured before piping the result.

Q: Can I monitor competitor prices in an automated pipeline with WebScrapingAPI and Claude Code?

Yes, use scrapeecommerceproduct. The tool returns price, title, and reviews as structured JSON. You can run this job hourly via a cron job and process the clean data.

Q: Do I need to specify parameters for unusual scrapes using WebScrapingAPI with Claude Code?

Yup. You can use customapiscrape. It lets you pass specific operational parameters like a target country or session ID, giving your script maximum control.

WebScrapingAPI for Claude Code: Run headless scraping jobs and pipe output directly into CI/CD pipelines.

See Vinkius in Action

Works with every AI agent you already use

…and any MCP-compatible client

MCP Servers - Free for Subscribers

Connect WebScrapingAPI MCP to Claude Code

Create your Vinkius account to connect WebScrapingAPI to Claude Code and route execution through our secure gateway. The platform manages server hosting, runtime updates, and security layers. Configuration requires no manual server provisioning.

GDPR Free for Subscribers

Setup WebScrapingAPI with Claude Code

Ask AI about this MCP

ChatGPT

Claude

Perplexity

High-Anonymity Scraping for Pipelines

When your script needs to run in a Docker container or GitHub Action, use `scrape_via_residential_proxy`. It scrapes using residential proxies, giving you the anonymity needed for reliable automation. This tool is essential for running jobs that mimic real user behavior and need to bypass rate limits.

Structured Data Extraction from E-commerce

Don't deal with messy text. The `scrape_ecommerce_product` tool returns product details—price, title, and reviews—as structured JSON. You can pipe this clean output directly into a database or another script. This is perfect for scheduled jobs that need to monitor inventory changes across multiple stores.

Retrieving Structured Search Results

Need search data as part of an automated workflow? The `search_google_serp` tool provides structured JSON results from Google. You can execute this in a shell script and pipe the output to process records. It's reliable for tasks like monitoring competitor visibility over time.

Setup guide

Set up WebScrapingAPI MCP in Claude Code

Prerequisites

Claude Code CLI installed (npm install -g @anthropic-ai/claude-code)
Active Vinkius subscription with a valid endpoint token

1

Run the add command

Open your terminal and run the command shown on the right. Replace [YOUR_TOKEN_HERE] with your endpoint token from cloud.vinkius.com. Use --scope user to make it available across all projects.
2

Verify the connection

Start a Claude Code session and type /mcp to list connected servers. You should see webscrapingapi-mcp with a green status indicator.
3

Start using tools

Ask Claude Code something like "Check my latest WebScrapingAPI transactions." It will automatically discover and invoke the available WebScrapingAPI tools.

Terminal

claude mcp add --transport http webscrapingapi-mcp https://edge.vinkius.com/[YOUR_TOKEN_HERE]/mcp

Get your connection token →

Prerequisites

Claude Code CLI installed
Active Vinkius subscription with a valid endpoint token

1

Open the config file

Create or edit .mcp.json in your project root for project-level scope, or ~/.claude.json for user-level scope.
2

Add the WebScrapingAPI MCP

Paste the JSON snippet shown on the right into the mcpServers object. Replace [YOUR_TOKEN_HERE] with your endpoint token from cloud.vinkius.com.
3

Restart Claude Code

Start a new Claude Code session. Type /mcp to confirm the server is connected. The tools will be automatically available in your conversation.

.mcp.json

{
  "mcpServers": {
    "webscrapingapi-mcp": {
      "type": "url",
      "url": "https://edge.vinkius.com/[YOUR_TOKEN_HERE]/mcp"
    }
  }
}

Get your connection token →

Independent Platform Disclaimer: Vinkius is an independent platform and is not affiliated with, endorsed by, sponsored by, verified by, or otherwise authorized by WebScrapingAPI. All third-party trademarks, logos, and brand names are the property of their respective owners. Their use on this website is strictly for informational purposes to identify service compatibility and interoperability.

Why Choose Vinkius

Vinkius connects your tools to AI with real-time monitoring and automatic cost savings — all from one dashboard.

Connect WebScrapingAPI now

Real-time monitoring

Live

visibility into every interaction

Connect your favorite tools to your AI and see exactly what's happening — every request, every response, in real time.

Built-in savings

60%

lower AI costs

Vinkius compresses data between your apps and your AI automatically. Lower bills every month — no configuration required.

Single dashboard

One

place for every integration

Every tool your AI connects to, managed from a single screen. One account, complete control.

Common questions about WebScrapingAPI MCP in Claude Code

You would use the `search_google_serp` tool in a shell script. You run it headless, capture its structured JSON output via stdout, and pipe that data into your processing logic.

Use `scrape_js_rendered`. It executes the scraping job using a full headless browser environment. This ensures that JavaScript-loaded content is fully captured before piping the result.

Yes, use `scrape_ecommerce_product`. The tool returns price, title, and reviews as structured JSON. You can run this job hourly via a cron job and process the clean data.

This server handles public web content, including URLs and raw HTML. The specific data type involved is publicly accessible web data captured by the scraping tools.

Yup. You can use `custom_api_scrape`. It lets you pass specific operational parameters like a target country or session ID, giving your script maximum control.

Use it with your favorite AI tools

Connect this server to Cursor, Claude, VS Code, and more.

OpenAI Agents SDK sdk-python

Google ADK sdk-python

Pydantic AI sdk-python

Vercel AI SDK sdk-typescript