Diffbot Connector for AI agents.
10 live capabilities
Pull structured data from any website for market research and e-commerce.
Waiting for input…
Why people use Diffbot
Diffbot for Automated Web Data Extraction
This Connector replaces that manual loop. You just give your agent a URL, and it handles the classification and extraction. You get a clean JSON object containing exactly what you need, whether it's a product's SKU or an article's author.
What Vinkius changes
You get structured data from any website using plain English commands.
Use it from Claude, ChatGPT, Cursor or another AI client you already have.
One account · 5,900+ Connectors
- Real-world use case 01
Competitor Pricing
A retail manager asks for a table of prices for a specific shoe across five different websites.
- Real-world use case 02
Job Market Trends
A recruiter asks the agent to find all Senior Engineer roles in Austin with salary info.
- Real-world use case 03
Sentiment Tracking
A brand manager wants to see the last 20 reviews for a product to see if people are complaining about a bug.
Complete set · 10capabilities
The complete Diffbot capability set.
These are the exact actions your AI can choose when you ask it to work with Diffbot.
01—04
4 capabilities in this set.
Part of 10 available through Diffbot.
- 01 Capability
Extract product
Grabs SKU, brand, price, and specs from e-commerce listings.
- 02 Capability
Analyze page
Automatically classifies a URL as a product, article, or list and returns structured JSON.
- 03 Capability
Extract article
Pulls clean text and metadata from news or blog posts while skipping comments if requested.
- 04 Capability
Extract custom api
Executes your specific rulesets to pull data that doesn't fit standard categories.
05—07
3 capabilities in this set.
Part of 10 available through Diffbot.
- 05 Capability
Extract discussion
Grabs forum threads, user reviews, and comments for sentiment analysis.
- 06 Capability
Extract event
Pulls schedules and specific details from event listing pages.
- 07 Capability
Extract image
Identifies and extracts the primary images from a webpage.
08—10
3 capabilities in this set.
Part of 10 available through Diffbot.
- 08 Capability
Extract job
Pulls job titles, employers, and salary info from recruitment pages.
- 09 Capability
Extract list
Scrapes search results or directory items into a clean array of links and titles.
- 10 Capability
Extract video
Pulls video content and metadata from media heavy pages.
Set up in minutes
One URL. Then ask Diffbot to work.
Claude and ChatGPT only need the Connector URL. Copy it once, add it in settings, and use Diffbot from the conversation.
Choose your client
Live previewAdvanced clients IDE · CLI
Claude · Web + desktop
Connector URL · ready to paste
Streamable HTTPhttps://edge.vinkius.com/vk_preview_FiT28RroNiKkMcafLWUuAoeV2pbdaAk9JBpgecYE/mcp - Step 01
Open Connectors
In Claude Web or Claude Desktop, open Settings and choose Connectors.
- Step 02
Add the URL
Choose Add custom connector, name it Diffbot, and paste the URL above.
- Step 03
Turn it on in chat
Select +, open Connectors, and enable Diffbot for the conversation.
ChatGPT · Web + desktop
Connector URL · ready to paste
Streamable HTTPhttps://edge.vinkius.com/vk_preview_FiT28RroNiKkMcafLWUuAoeV2pbdaAk9JBpgecYE/mcp - Step 01
Open MCP settings
On desktop, open Settings and MCP servers. On web, open your workspace app or connector settings.
- Step 02
Add the URL
Choose Add server with Streamable HTTP, or create a custom MCP app, then paste the Diffbot URL.
- Step 03
Save and start
Save the connection and enable Diffbot in your conversation. Desktop may ask you to restart once.
Cursor · IDE configuration
Advanced setup
{
"mcpServers": {
"diffbot": {
"url": "https://edge.vinkius.com/vk_preview_FiT28RroNiKkMcafLWUuAoeV2pbdaAk9JBpgecYE/mcp"
}
}
}- Step 01
Open MCP Settings
Press Cmd+Shift+P (macOS) or Ctrl+Shift+P (Windows/Linux) → search "MCP Settings"
- Step 02
Add the server config
Paste the JSON configuration above into the mcp.json file that opens
- Step 03
Save the file
Cursor will automatically detect the new Connector
- Step 04
Start using Diffbot
Open Agent mode in chat and ask: "Using Diffbot, help me...". 10 tools available
VS Code Copilot · IDE configuration
Advanced setup
{
"mcpServers": {
"diffbot": {
"url": "https://edge.vinkius.com/vk_preview_FiT28RroNiKkMcafLWUuAoeV2pbdaAk9JBpgecYE/mcp"
}
}
}- Step 01
Create MCP config
Create a .vscode/mcp.json file in your project root
- Step 02
Add the server config
Paste the JSON configuration above
- Step 03
Enable Agent mode
Open GitHub Copilot Chat and switch to Agent mode using the dropdown
- Step 04
Start using Diffbot
Ask Copilot: "Using Diffbot, help me...". 10 tools available
Windsurf · IDE configuration
Advanced setup
{
"mcpServers": {
"diffbot": {
"url": "https://edge.vinkius.com/vk_preview_FiT28RroNiKkMcafLWUuAoeV2pbdaAk9JBpgecYE/mcp"
}
}
}- Step 01
Open MCP Settings
Go to Settings → MCP Configuration or press Cmd+Shift+P and search "MCP"
- Step 02
Add the server
Paste the JSON configuration above into mcp_config.json
- Step 03
Save and reload
Windsurf will detect the new server automatically
- Step 04
Start using Diffbot
Open Cascade and ask: "Using Diffbot, help me...". 10 tools available
Cline · IDE configuration
Advanced setup
{
"mcpServers": {
"diffbot": {
"url": "https://edge.vinkius.com/vk_preview_FiT28RroNiKkMcafLWUuAoeV2pbdaAk9JBpgecYE/mcp"
}
}
}- Step 01
Open Cline MCP Settings
Click the Connectors icon in the Cline sidebar panel
- Step 02
Add remote server
Click "Add Connector" and paste the configuration above
- Step 03
Enable the server
Toggle the server switch to ON
- Step 04
Start using Diffbot
Ask Cline: "Using Diffbot, help me...". 10 tools available
Claude Code · Terminal command
Advanced setup
claude mcp add diffbot --transport http "https://edge.vinkius.com/vk_preview_FiT28RroNiKkMcafLWUuAoeV2pbdaAk9JBpgecYE/mcp"- Step 01
Install Claude Code
Run npm install -g @anthropic-ai/claude-code if not already installed
- Step 02
Add the Connector
Run the command above in your terminal
- Step 03
Verify the connection
Run claude mcp to list connected servers, or type /mcp inside a session
- Step 04
Start using Diffbot
Ask Claude: "Using Diffbot, show me...". 10 tools are ready
Where the request belongs
Work Diffbot can move forward.
This is for the data analyst tired of broken scrapers, the market researcher who needs to monitor competitors at scale, and the content marketer who needs to keep tabs on brand sentiment across the web.
Market Researcher
Monitors competitor pricing and SKU changes across dozens of retail sites daily.
Data Analyst
Pulls large datasets from directories or search results to feed into internal dashboards.
Content Marketer
Scans forums and news sites to identify trending topics and brand mentions.
Build the capability set
Add more capabilities.
Each Connector adds new actions and data without changing how you work.
Browse ConnectorsDiffbot
Extract structured data from any web page using AI that understands content like a human and builds knowledge graphs automatically.
Firecrawl
Turn any website into clean, LLM-ready Markdown with a single API call. scrape, crawl, search, and map the entire web for your AI agent.
Browse AI
Automate web scraping with Browse AI. run extraction robots, monitor page changes, and retrieve bulk data directly from any AI agent.
Grepsr
Automate web scraping via Grepsr. manage reports, trigger crawls, and retrieve data directly via AI.
Bring your own AI
Change the model, client or framework. Keep Diffbot connected.
-
Claude -
ChatGPT -
Gemini -
Cursor -
VS Code -
Windsurf -
ZCode -
Cline -
Zed -
Continue -
Kiro -
Roo Code -
Zencoder -
Goose -
Void -
Augment Code -
Amp -
Qodo -
Tabnine -
Pieces -
Sourcegraph Cody -
JetBrains -
Warp -
Amazon Q -
Antigravity -
BoltAI -
Raycast -
Jan -
LM Studio -
AnythingLLM -
Open WebUI -
Msty -
Cherry Studio -
LibreChat -
TypingMind -
Chorus -
5ire -
n8n -
LangChain -
LlamaIndex -
CrewAI -
Vercel AI SDK
Before you connect
Questions about Diffbot.
The practical details behind the request, access and result.
Can the Diffbot MCP scrape websites that don't have a standard layout?
Yes. It uses machine learning to identify content regardless of the site's design, so you don't have to worry about different layouts.
Does the Diffbot MCP work for e-commerce product research?
It is built specifically for that. You can easily pull prices, brands, and SKUs from retail websites to build your own product databases.
Can I use the Diffbot MCP to monitor my competitors?
Yes, it's a great capability for tracking pricing and product changes across different web boundaries without manual checking.
How does the Diffbot MCP handle forum comments and reviews?
It pulls threads and reviews into a structured format, making it easy for your agent to analyze sentiment or summarize user feedback.
Can the Diffbot MCP extract job postings for market research?
Yes. It maps titles, employers, and salaries so you can track hiring trends and salary benchmarks in your industry.
Is the Diffbot MCP good for gathering news from multiple sources?
It's excellent for this. It handles articles and blogs, making it easy to aggregate content and summaries from various news sites.
Can my agent automatically identify what kind of page a URL points to?
Yes. Use the 'analyze_page' capability. Diffbot uses ML to classify the URL as an article, product, image, video, or list, and returns the appropriate structured JSON payload automatically.
How do I extract only the main text from a blog post without comments?
Use the 'extract_article' capability and set the 'discussion' parameter to 'false'. The agent will retrieve the clean text and HTML body while explicitly ignoring any forum threads or review blocks on the page.
Can I use custom extraction rules I've defined in my Diffbot dashboard?
Absolutely. Use the 'extract_custom_api' capability. Provide your trained 'api_name' and the target URL. Diffbot will extract the data according to your specific structural ruleset natively.
One connection away
Give your agent a direct line to Diffbot.
Connect Diffbot once. Keep it beside 5,900+ managed Connectors when the next task needs more.
Explore every Connector No credit card required · Free tier available