How to Use the Web Scraper MCP in VS Code Copilot

Q: How does Web Scraper integrate with VS Code Copilot?

You add it once via .vscode/mcp.json. Every developer on the team gets access to all its tools, allowing Copilot Chat to use web data when generating code or documentation.

Q: Can Web Scraper help with multiple source pages in VS Code Copilot?

Yes. Use batchread to fetch content from up to 10 URLs simultaneously. This is great for creating comparison functions or building a report that needs data points from several sources.

Q: Is Web Scraper reliable for getting structured web metadata in VS Code Copilot?

It's highly reliable. The extract tool gives you specific, clean fields like title, description, and lang. You can then write code that expects these exact data types.

Q: Does Web Scraper help me map site links using VS Code Copilot?

The listlinks tool pulls all internal hyperlinks from a page, giving your agent a definitive list of potential endpoints or related documentation sections to include in the code.

Team-Wide Web Data Access for VS Code Copilot: Centralized Tools Via MCP Server.

See Vinkius in Action

Works with every AI agent you already use

…and any MCP-compatible client

MCP Servers - Free for Subscribers

Connect Web Scraper MCP to VS Code Copilot

Create your Vinkius account to connect Web Scraper to VS Code Copilot and route execution through our secure gateway. The platform manages server hosting, runtime updates, and security layers. Configuration requires no manual server provisioning.

GDPR Free for Subscribers

Setup Web Scraper with VS Code Copilot

Ask AI about this MCP

ChatGPT

Claude

Perplexity

Fetch Article Content with `read` via MCP Server

The `read` tool gets the full, cleaned text from any public URL and hands it over as Markdown. Because this is configured in your team's `.vscode/mcp.json`, every developer on the team has access to pull source material directly into their workflow. This means that when Copilot suggests code or documentation, it can reference live web content retrieved by the `read` tool, keeping everything consistent across the whole repo.

Contextual Metadata using MCP Server

Need to know what a source page is about before writing against its data? The `extract` tool pulls structured metadata—like Open Graph tags and canonical URLs. This lets your team enforce consistency by validating external sources. It's perfect for API clients that rely on accurate source descriptions or language tagging.

Systematic Site Discovery with Crawling

When integrating documentation, you often need multiple pages. The `crawl` tool visits a site starting from one URL and gathers content from up to 10 related pages. Your team can then process this batch of content as a single unit. This prevents developers from having to manually bookmark and paste dozens of URLs into the chat window.

Setup guide

Set up Web Scraper MCP in VS Code Copilot

Prerequisites

VS Code 1.99 or later with GitHub Copilot extension
Active Vinkius subscription with a valid endpoint token

1

Open MCP configuration

Open the Command Palette (Cmd+Shift+P / Ctrl+Shift+P) and run "MCP: Add Server". Select HTTP (Streamable) as the server type. VS Code will create .vscode/mcp.json in your workspace.
2

Add the Web Scraper MCP

Paste the JSON snippet shown on the right into your .vscode/mcp.json. Replace [YOUR_TOKEN_HERE] with your endpoint token from cloud.vinkius.com.
3

Switch to Agent mode

Open Copilot Chat (Cmd+Shift+I / Ctrl+Shift+I) and switch to Agent mode using the dropdown. MCP tools are only available in Agent mode — they do not appear in Edit or Ask modes.
4

Verify the connection

In the Copilot Chat input, type # to list available tools. You should see the Web Scraper tools listed. Try asking: "List my recent Web Scraper transactions" and Copilot will invoke them automatically.

.vscode/mcp.json

{
  "mcpServers": {
    "web-scraper-mcp": {
      "url": "https://edge.vinkius.com/[YOUR_TOKEN_HERE]/mcp"
    }
  }
}

Get your connection token →

Independent Platform Disclaimer: Vinkius is an independent platform and is not affiliated with, endorsed by, sponsored by, verified by, or otherwise authorized by Web Scraper. All third-party trademarks, logos, and brand names are the property of their respective owners. Their use on this website is strictly for informational purposes to identify service compatibility and interoperability.

Why Choose Vinkius

Vinkius connects your tools to AI with real-time monitoring and automatic cost savings — all from one dashboard.

Connect Web Scraper now

Real-time monitoring

Live

visibility into every interaction

Connect your favorite tools to your AI and see exactly what's happening — every request, every response, in real time.

Built-in savings

60%

lower AI costs

Vinkius compresses data between your apps and your AI automatically. Lower bills every month — no configuration required.

Single dashboard

One

place for every integration

Every tool your AI connects to, managed from a single screen. One account, complete control.

Common questions about Web Scraper MCP in VS Code Copilot

You add it once via `.vscode/mcp.json`. Every developer on the team gets access to all its tools, allowing Copilot Chat to use web data when generating code or documentation.

Yes. Use `batch_read` to fetch content from up to 10 URLs simultaneously. This is great for creating comparison functions or building a report that needs data points from several sources.

It's highly reliable. The `extract` tool gives you specific, clean fields like `title`, `description`, and `lang`. You can then write code that expects these exact data types.

The `list_links` tool pulls all internal hyperlinks from a page, giving your agent a definitive list of potential endpoints or related documentation sections to include in the code.

This server touches public web content, specifically text (Markdown) and structured metadata like `title`, `description`, and `lang`. All information is derived from publicly accessible URLs.

Use it with your favorite AI tools

Connect this server to Cursor, Claude, VS Code, and more.

OpenAI Agents SDK sdk-python

Google ADK sdk-python

Pydantic AI sdk-python

Vercel AI SDK sdk-typescript