Bring Web Scraping
to Claude Desktop
Create your Vinkius account to connect Diffbot to Claude Desktop and start using all 10 AI tools in minutes. Fully managed, enterprise secure, and ready to use without writing a single line of code. No hosting, no server setup — just connect and start using.
GDPR Free for SubscribersCompatible with every major AI agent and IDE
Gemini
What is the Diffbot MCP Server?
Connect your Diffbot account to any AI agent and take full control of your automated web data extraction through natural conversation.
What you can do
- Automated Page Classification — Use the Analyze API to automatically determine if a page is an article, product, or list and extract structured data natively
- Article Extraction — Extract news, blog, or article content into clean HTML and plain text, identifying authors, dates, and categorical classifications limitlessly
- E-commerce Intelligence — Capture structured product details including precise pricing, brand mappings, SKU, and specifications across any web boundary
- Media & Social Auditing — Extract primary images and embedded video metadata, or analyze forum threads and reviews with automated sentiment scoring
- List & Search Scraping — Identify bounded directories and search results on any page to extract arrays of item titles and links strictly
- Job Posting Analysis — Retrieve explicitly mapped job titles, employers, and salary vectors from recruitment pages to monitor market trends
- Custom Rule Execution — Execute user-defined custom extraction logic by bridging raw URLs to your trained Diffbot dashboard rulesets
How it works
- Subscribe to this server
- Enter your Diffbot Developer Token (found in your Diffbot Dashboard > Manage Token)
- Start transforming the web into data from Claude, Cursor, or any MCP-compatible client
Who is this for?
- Data Analysts — extract structured data from thousands of websites without writing complex scrapers or selectors
- Market Researchers — monitor competitor products and pricing across the web using natural language
- Content Marketers — summarize articles and monitor brand mentions in forum discussions in real-time
- Developers — test and debug web extraction pipelines and custom Diffbot rules through natural conversation
Built-in capabilities (10)
Diffbot uses ML to determine if the page is an article, product, image, video, event, list, or job, and returns the appropriate structured JSON. Excellent generalized entry point. Automatically classify and extract page data using Diffbot Analyze API
Pass optional discussion=false to skip extracting comments. Extract news, blog, or article content using Diffbot Article API
Diffbot will extract data according to your custom ruleset. Extract using a user-defined custom Diffbot API
Extract forum threads, reviews, or comments using Diffbot Discussion API
Extract event schedules and details using Diffbot Event API
Extract main images from a page using Diffbot Image API
Extract job postings using Diffbot Job API
Extract lists or search results using Diffbot List API
Extract e-commerce product details using Diffbot Product API
Extract video content and metadata using Diffbot Video API
Why Claude Desktop?
Claude Desktop is the definitive way to connect Diffbot to your AI workflow. Add Vinkius Edge URL to your config, restart the app, and Claude immediately exposes all 10 tools in the chat interface. ask a question, Claude calls the right tool, and you see the answer. Zero code, zero context switching.
- —
Claude Desktop is the reference MCP client. it was designed alongside the protocol itself, ensuring the most complete and stable MCP implementation available
- —
Zero-code configuration: add a server URL to a JSON file and Claude instantly discovers and exposes all available tools in the chat interface
- —
Claude's extended thinking capability lets it reason through multi-step tool usage, chaining multiple API calls to answer complex questions
- —
Enterprise-grade security with local config storage. your tokens never leave your machine, and connections go directly to Vinkius Edge network
Diffbot in Claude Desktop
Why run Diffbot with Vinkius?
The Diffbot connection runs on our fully managed, secure cloud infrastructure. We handle the hosting, maintenance, and security so you don't have to deal with servers or code. All 10 tools are ready to work instantly without any complex setup.
You stay in complete control of your data. Your AI only accesses the information you approve, keeping your sensitive passwords and private details completely safe. Plus, with automatic optimizations, your AI works faster and more efficiently.
* Every connection is hosted and maintained by Vinkius. We handle the security, updates, and infrastructure so you don't have to write code or manage servers. See our infrastructure
Over 4,000 integrations ready for AI agents
Explore a vast library of pre-built integrations, optimized and ready to deploy.
Connect securely in under 30 seconds
Generate tokens to authenticate and link external services in a single step.
Complete visibility into every agent action
Audit live requests, latency, success rates, and active security compliance policies.
Optimize spending and track token ROI
Analyze real-time token consumption and cost metrics detailed by connection.
Explore our live AI Agents Analytics dashboard to see it all working
This dashboard is included when you connect Diffbot using Vinkius. You will never be left in the dark about what your AI agents are doing with your tools.
Diffbot and 4,000+ other AI tools. No hosting, no code, ready to use.
Professionals who connect Diffbot to Claude Desktop through Vinkius don't need to write code, manage servers, or worry about security. Everything is pre-configured, secure, and runs automatically in the background.
Raw MCP | Vinkius | |
|---|---|---|
| Ready-to-use MCPs | Find and configure each manually | 4,000+ MCPs ready to use |
| Connection Setup | Manual coding & server setup | 1-click instant connection |
| Server Hosting | You host it yourself (needs 24/7 uptime) | 100% hosted & managed by Vinkius |
| Security & Privacy | Stored in plaintext config files | Bank-grade encrypted vault |
| Activity Visibility | Blind execution (no logs or tracking) | Live dashboard with real-time logs |
| Cost Control | Runaway AI token spend risk | Automatic budget limits |
| Revoking Access | Must delete files or code to stop | 1-click disconnect button |
How Vinkius secures
Diffbot for Claude Desktop
Every request between Claude Desktop and Diffbot is protected by our secure gateway. We automatically keep your sensitive data private, prevent unauthorized access, and let you disconnect instantly at any time.
Frequently asked questions
Can my agent automatically identify what kind of page a URL points to?
Yes. Use the 'analyze_page' tool. Diffbot uses ML to classify the URL as an article, product, image, video, or list, and returns the appropriate structured JSON payload automatically.
How do I extract only the main text from a blog post without comments?
Use the 'extract_article' tool and set the 'discussion' parameter to 'false'. The agent will retrieve the clean text and HTML body while explicitly ignoring any forum threads or review blocks on the page.
Can I use custom extraction rules I've defined in my Diffbot dashboard?
Absolutely. Use the 'extract_custom_api' tool. Provide your trained 'api_name' and the target URL. Diffbot will extract the data according to your specific structural ruleset natively.
How does Claude Desktop discover MCP tools?
When Claude Desktop starts, it reads the claude_desktop_config.json file and connects to each configured MCP server. It calls the tools/list endpoint to fetch the schema for every available tool, then surfaces them as clickable options in the chat interface via the 🔌 icon.
What happens if the MCP server is temporarily unavailable?
Claude Desktop handles disconnections gracefully. if the server is unreachable at startup, the tools simply won't appear. Once the server becomes available again, restarting Claude Desktop will re-establish the connection. There is no timeout penalty or error loop.
Can I connect multiple MCP servers simultaneously?
Yes. You can add as many servers as you need in the mcpServers section of the config file. Each server appears as a separate tool provider, and Claude can use tools from multiple servers in a single conversation turn.
Is there a limit on the number of tools per server?
Claude Desktop can handle hundreds of tools per server. However, for optimal LLM performance, Vinkius servers are designed to expose focused, well-documented tool sets rather than overwhelming the model with too many options.
Does Claude Desktop support Streamable HTTP transport?
Yes. Claude Desktop supports both SSE (Server-Sent Events) and the newer Streamable HTTP transport that Vinkius uses. Simply provide the server URL. Claude auto-negotiates the transport protocol.
Server not appearing after restart
Ensure the JSON is valid (no trailing commas). Check the file path: ~/Library/Application Support/Claude/claude_desktop_config.json (macOS) or %APPDATA%\\Claude\\ (Windows).
Authentication error
Verify your Vinkius token is correct. Go to cloud.vinkius.com to regenerate it if needed.
Tools not showing in chat
Click the 🔌 icon at the bottom of the chat input. If it shows 0 tools, the server may still be connecting. wait a few seconds.
Explore More MCP Servers
View all →
Route4Me
10 toolsConnect your Route4Me account to AI agents to manage addresses, routes, optimizations, and vehicles.
Data.gov
13 toolsSearch 300,000+ US government open datasets — agriculture, climate, education, health, finance and more.
OceanBase
10 toolsEnterprise distributed relational database — manage clusters, tenants, and databases via AI.
API Ninjas
8 toolsAccess fitness, health and nutrition tools — search exercises, calculate calories, body fat, BMR, TDEE and get nutrition info.