How to Use the URL Metadata Scraper MCP in OpenAI Agents SDK

Q: How does the URL Metadata Scraper interact with OpenAI Agents SDK?

The scrapeurl tool exposes itself to your agent's toolkit, letting it call for metadata when needed. Your agents automatically discover this capability and can use it as a reliable source of truth before proceeding.

Extract clean SEO metadata instantly, making your OpenAI Agents SDK workflows reliable.

See Vinkius in Action

Works with every AI agent you already use

…and any MCP-compatible client

MCP Servers - Free for Subscribers

Connect URL Metadata Scraper MCP to OpenAI Agents SDK

Create your Vinkius account to connect URL Metadata Scraper to OpenAI Agents SDK and route execution through our secure gateway. The platform manages server hosting, runtime updates, and security layers. Configuration requires no manual server provisioning.

GDPR Free for Subscribers

Setup URL Metadata Scraper with OpenAI Agents SDK

Ask AI about this MCP

ChatGPT

Claude

Perplexity

Fast Metadata Extraction

The `scrape_url` tool pulls structured OpenGraph and standard SEO data—titles, descriptions, and images—right from a full URL. You get this metadata instantly without having to load or render an entire webpage using a headless browser. This speed saves you tokens when building complex agent chains. It's perfect for link preview generation or running quick SEO audits on batch lists of URLs.

Structured Data Outputs

The tool returns the metadata in a clean, predictable format that your agents can process immediately. Instead of dealing with messy HTML, you receive JSON containing just the required OpenGraph fields. Agents consume this structured output directly, making subsequent steps—like validating content or generating social media captions—much simpler.

Validation and Auditing

Use `scrape_url` to validate that external links contain the necessary SEO tags. You can check if a site has a proper title and description before your agent uses it for content generation. This capability is crucial for building reliable, production-grade agents that depend on accurate source material.

Setup guide

Set up URL Metadata Scraper MCP in OpenAI Agents SDK

Prerequisites

Python 3.10+ installed
openai-agents package (pip install openai-agents)
Active Vinkius subscription with a valid endpoint token

1

Install the SDK

Run pip install openai-agents to install the OpenAI Agents SDK. The MCP integration is built-in — no extra dependencies needed.
2

Connect via SSE transport

Use MCPServerSse with your Vinkius endpoint URL. Replace [YOUR_TOKEN_HERE] with your token from cloud.vinkius.com. The SDK auto-discovers all URL Metadata Scraper tools at runtime.
3

Create your Agent

Pass the MCP to Agent(mcp_servers=[server]). The agent receives URL Metadata Scraper tools as native definitions — JSON schemas resolve automatically.
4

Run the agent

Call Runner.run(agent, prompt) to execute. The agent invokes the appropriate URL Metadata Scraper tools and returns structured results. Copy the full example on the right to get started.

agent.py

import asyncio
from agents import Agent, Runner
from agents.mcp import MCPServerSse

async def main():
    async with MCPServerSse(
        url="https://edge.vinkius.com/[YOUR_TOKEN_HERE]/mcp"
    ) as server:
        agent = Agent(
            name="URL Metadata Scraper Agent",
            instructions="You have access to URL Metadata Scraper tools.",
            mcp_servers=[server],
        )
        result = await Runner.run(agent, "List recent transactions")
        print(result.final_output)

asyncio.run(main())

Get your connection token →

Independent Platform Disclaimer: Vinkius is an independent platform and is not affiliated with, endorsed by, sponsored by, verified by, or otherwise authorized by Cheerio Scraper. All third-party trademarks, logos, and brand names are the property of their respective owners. Their use on this website is strictly for informational purposes to identify service compatibility and interoperability.

Why Choose Vinkius

Vinkius connects your tools to AI with real-time monitoring and automatic cost savings — all from one dashboard.

Connect URL Metadata Scraper now

Real-time monitoring

Live

visibility into every interaction

Connect your favorite tools to your AI and see exactly what's happening — every request, every response, in real time.

Built-in savings

60%

lower AI costs

Vinkius compresses data between your apps and your AI automatically. Lower bills every month — no configuration required.

Single dashboard

One

place for every integration

Every tool your AI connects to, managed from a single screen. One account, complete control.

Common questions about URL Metadata Scraper MCP in OpenAI Agents SDK

The `scrape_url` tool exposes itself to your agent's toolkit, letting it call for metadata when needed. Your agents automatically discover this capability and can use it as a reliable source of truth before proceeding.

Yes, you can loop through lists of URLs within your agent's logic. Simply call `scrape_url` repeatedly for each endpoint to gather a batch of metadata records.

It extracts OpenGraph data, which includes the primary image URL. You get the link to the image directly in the structured output, so your agents know exactly where to find it.

It focuses on core SEO tags: Title, Description, and Image. This means you get all the necessary information for link previews or basic content validation.

It's designed to be fast and non-invasive; it doesn't require loading a full browser, minimizing risk and keeping the process highly efficient.

Use it with your favorite AI tools

Connect this server to Cursor, Claude, VS Code, and more.

OpenAI Agents SDK sdk-python

Google ADK sdk-python

Pydantic AI sdk-python