How to Use the Diffbot MCP in Vercel AI SDK

Turn messy web pages into clean JSON within your AI-sdk apps. Stop writing custom scrapers and let your front-end handle live data.

See Vinkius in Action

Works with every AI agent you already use

…and any MCP-compatible client

MCP Servers - Free for Subscribers

Connect Diffbot MCP to Vercel AI SDK

Create your Vinkius account to connect Diffbot to Vercel AI SDK and route execution through our secure gateway. The platform manages server hosting, runtime updates, and security layers. Configuration requires no manual server provisioning.

GDPR Free for Subscribers

Setup Diffbot with Vercel AI SDK

Ask AI about this MCP

ChatGPT

Claude

Perplexity

Real-time web extraction for AI-sdk

Stop wrestling with DOM selectors. Use `analyze_page` to automatically categorize content and feed it directly into your streaming UI components. Your AI-sdk application gets structured JSON instantly. The data flows from the web to your users without the usual middle-man scraping headaches.

Product and article parsing

Feed URLs to `extract_product` or `extract_article` to pull specific details like pricing, descriptions, or body text. These tools return clean objects ready for your state management. Your AI-sdk project remains lean because you aren't maintaining fragile regex patterns. Just call the tool and render the result.

Custom rule execution

Handle proprietary site structures using `extract_custom_api`. Define your rules once in the platform and let your AI-sdk agent fetch exactly what you need. This keeps your codebase focused on user experience. You define the logic, and this MCP Server does the heavy lifting of data retrieval.

Setup guide

Set up Diffbot MCP in Vercel AI SDK

Prerequisites

Node.js 18+ and a TypeScript project
ai + @modelcontextprotocol/sdk packages
Active Vinkius subscription with a valid endpoint token

1

Install dependencies

Run npm install ai @modelcontextprotocol/sdk plus your preferred model provider (e.g. @ai-sdk/openai).
2

Create the Streamable HTTP transport

Use StreamableHTTPClientTransport with your Vinkius endpoint URL. Replace [YOUR_TOKEN_HERE] with your token from cloud.vinkius.com.
3

Discover and use tools

Call mcpClient.tools() to auto-discover all Diffbot tools. Pass them directly to generateText() or streamText() — no manual schema definitions needed.
4

Works with any model provider

Swap openai("gpt-4o") for any AI SDK provider — Anthropic, Google, Mistral. The MCP tools work identically across all supported models.

index.ts

import { experimental_createMCPClient as createMCPClient } from "ai";
import { StreamableHTTPClientTransport } from "@modelcontextprotocol/sdk/client/streamableHttp";
import { generateText } from "ai";
import { openai } from "@ai-sdk/openai";

const transport = new StreamableHTTPClientTransport(
  new URL("https://edge.vinkius.com/[YOUR_TOKEN_HERE]/mcp")
);

const mcpClient = await createMCPClient({ transport });
const tools = await mcpClient.tools();

const { text } = await generateText({
  model: openai("gpt-4o"),
  tools,
  prompt: "List recent Diffbot transactions",
});

console.log(text);
await mcpClient.close();

Get your connection token →

Independent Platform Disclaimer: Vinkius is an independent platform and is not affiliated with, endorsed by, sponsored by, verified by, or otherwise authorized by Diffbot. All third-party trademarks, logos, and brand names are the property of their respective owners. Their use on this website is strictly for informational purposes to identify service compatibility and interoperability.

Why Choose Vinkius

Vinkius connects your tools to AI with real-time monitoring and automatic cost savings — all from one dashboard.

Connect Diffbot now

Real-time monitoring

Live

visibility into every interaction

Connect your favorite tools to your AI and see exactly what's happening — every request, every response, in real time.

Built-in savings

60%

lower AI costs

Vinkius compresses data between your apps and your AI automatically. Lower bills every month — no configuration required.

Single dashboard

One

place for every integration

Every tool your AI connects to, managed from a single screen. One account, complete control.

Common questions about Diffbot MCP in Vercel AI SDK

Install the MCP client package and initialize it with your server endpoint. Once connected, your AI-sdk agent gains immediate access to all extraction tools.

Yes. The backend renders the page before extraction, meaning your AI-sdk app receives structured data regardless of how the site is built.

Absolutely. Since the results are JSON, they stream perfectly into your React or Next.js components as soon as the tool returns the data.

The platform updates its extraction models automatically. You don't need to change your AI-sdk code when a target website updates its design.

Your extracted data is processed in an ephemeral sandbox. We only touch the public web pages you request and never store your private application state.

Use it with your favorite AI tools

Connect this server to Cursor, Claude, VS Code, and more.

OpenAI Agents SDK sdk-python

Google ADK sdk-python

Pydantic AI sdk-python

Vercel AI SDK sdk-typescript