- MISSING
- LENGTH
- DUPLICATE
- HUMAN
Short answer
How can I audit SEO metadata with my AI?
Your AI uses the scrape_url tool to visit web addresses and extract the title and description tags. You'll get a clear list of what's actually live on your pages so you can spot missing or broken tags. You'll see exactly where your SEO needs work.
Audit results.
Where your findings land.
The AI organizes the scraped data into specific categories for you.
MISSING
Empty tags found
The AI identifies URLs where the title or description is absent. You'll see which pages are invisible to search engines.
LENGTH
Character count issues
The AI flags titles that are too long or descriptions that are too short. This helps you stay within search engine limits.
DUPLICATE
Repeating metadata
The AI catches instances where multiple URLs share the same title or description. This helps prevent keyword cannibalization.
HUMAN
Manual review needed
The AI highlights suspicious or low-quality text. You decide if the copy needs a human rewrite.
The workflow
What your AI does when the URLs arrive.
The AI handles the heavy lifting of visiting pages and reading their code.
Fetch page data
The AI visits the URLs you provide to access the underlying HTML.
scrape_urlExtract tags
The agent pulls the specific title and meta description strings from the scraped content.
scrape_urlAnalyze content
The AI compares the extracted text against your SEO requirements and length constraints.
scrape_urlReport findings
The AI compiles the errors and successes into a structured list for you to review.
scrape_url
Try it
Copy these to start.
Use these prompts to kick off your audit.
Starting points
These are opening lines. Swap the bracketed text for your actual data.
Cheerio Scraper Connector
You're all set. Choose your MCP client and follow the setup instructions.
https://edge.vinkius.com/vk_preview_8dCiPY0j2J0NrFWar9hvAPxfBBUFBYDVdWIuQXWE/mcpClaude Desktop
Follow the steps below to connect in seconds.
- 1In Claude Desktop, open Settings → Connectors.
- 2Click “Add custom connector” and paste the connector link above as the remote MCP server URL.
- 3Click Add and start a new chat — Cheerio Scraper capabilities are ready to use.
{
"mcpServers": {
"url-metadata-scraper-mcp": {
"url": "https://edge.vinkius.com/vk_preview_8dCiPY0j2J0NrFWar9hvAPxfBBUFBYDVdWIuQXWE/mcp"
}
}
}Scrape the metadata for these five URLs: [paste URLs here].
Check if the titles and descriptions for [paste URL] are within the recommended character limits.
Look at the metadata for [paste URL] and tell me if the description is missing.
Compare the meta descriptions for these URLs: [paste URLs here] and flag any duplicates.
Claude
ChatGPT
Cursor
VS Code
Windsurf
Claude Code
JetBrains
Cline
Start here
Connect URL Metadata Scraper once, then ask.
Just click the link to connect the MCP to your client. Your credentials stay encrypted, and you can start scraping immediately.
Connect URL Metadata Scraper to your AIFAQ
How this task behaves.
- 01
Can the AI change my website's metadata?
No. The AI can only read and report on the metadata that currently exists. You have to update your site manually.
- 02
Does the AI need a login to scrape my site?
No. The tool accesses the public-facing HTML of the URLs you provide.
- 03
Can it scrape pages behind a login?
No. The scrape_url tool only works on publicly accessible web pages.
- 04
Will it find broken links?
No. This tool is specifically for reading metadata, not for checking link integrity or 404 errors.
- 05
Can I upload a CSV of URLs?
Yes. You can paste a list of URLs from a spreadsheet directly into your chat to start the process.
More questions about URL Metadata Scraper? The Connector page answers them. See everything the URL Metadata Scraper Connector can do
Connect Cheerio Scraper to Claude, Cursor, ChatGPT & more
