• DATA
  • LISTS
  • HUMAN
  • FILES

How to extract social media profiles with your AI

Connect Crawlbase to your agent to pull data from social platforms. Once connected, your AI handles the scraping and data structuring for you.

Ask AI about this page

Short answer

How can I turn social media profiles into a contact list?

Your AI uses Crawlbase to scrape specific profiles from LinkedIn or X and then organizes that raw data into a structured JSON format. You'll end up with a clean list of names, bios, or handles ready for your CRM or spreadsheet.

The data outcomes

Where your data lands

This is what your AI produces after it finishes the scrape.

DATA

Structured contact lists

The AI converts messy profile pages into organized JSON objects. You get clean fields for names, locations, and bios.

LISTS

Targeted lead groups

Group profiles by specific criteria found during the scrape. Your agent builds lists based on the roles or industries it finds.

HUMAN

Manual verification

The AI flags uncertain data points for you to check. You decide which profiles are high-quality enough to use.

FILES

Ready-to-use files

The final output is formatted for easy import. You can move the data straight into your existing tools.

The workflow

What your AI does when the request arrives.

Your agent acts as the bridge between the social platform and your data files.

  1. Fetch LinkedIn data

    The agent targets specific LinkedIn URLs to pull profile details.

    scrape_linkedin

  2. Fetch X data

    The agent pulls public profile information from X handles.

    scrape_twitter

  3. Clean the data

    The agent takes the raw HTML or text and turns it into a structured format.

    scrape_json_format

  4. Organize the output

    The agent repeats the formatting process to ensure every profile follows the same schema.

    scrape_json_format

Try it

Copy these to start.

Use these prompts to kick off the scraping process.

Starting points

Replace the bracketed text with your specific targets like a LinkedIn URL or a specific industry.

Crawlbase Connector

You're all set. Choose your MCP client and follow the setup instructions.

Connector linkhttps://edge.vinkius.com/vk_preview_AcN0JE7lQv9RjbUnrxQnYlI9bigE4gxGmDTPSZBI/mcp

Claude Desktop

Follow the steps below to connect in seconds.

  1. 1In Claude Desktop, open Settings → Connectors.
  2. 2Click “Add custom connector” and paste the connector link above as the remote MCP server URL.
  3. 3Click Add and start a new chat — Crawlbase capabilities are ready to use.
Configuration · claude_desktop_config.jsonCopy
{
  "mcpServers": {
    "crawlbase-mcp": {
      "url": "https://edge.vinkius.com/vk_preview_AcN0JE7lQv9RjbUnrxQnYlI9bigE4gxGmDTPSZBI/mcp"
    }
  }
}
Copy into chat04

  • Scrape the LinkedIn profile at [URL] and give me a JSON list of their recent activity.

  • Find the bio and location for the X user [Handle] and format it as a contact card.

  • Extract a list of names and job titles from these LinkedIn profiles: [URL list].

  • Turn this X profile data into a structured JSON object with name, bio, and follower count.

  • Claude
  • ChatGPT
  • Cursor
  • VS Code
  • Windsurf
  • Claude Code
  • JetBrains
  • Cline

Start here

Connect Crawlbase once, then ask.

Just link your account once. Your credentials stay encrypted, and you can immediately start asking your agent to scrape data.

Connect Crawlbase to your AI

FAQ

How this task behaves

  • 01

    Can the AI log in to my social media accounts?

    No. The tools only scrape publicly available data through the connector.

  • 02

    Will the AI automatically upload this to my CRM?

    No. The AI produces the structured data, but you must handle the final upload to your CRM yourself.

  • 03

    Can I scrape profiles from Instagram?

    No. This connector is specifically built for LinkedIn and X.

  • 04

    Does the AI decide which profiles to scrape?

    No. You must provide the specific URLs or handles you want the agent to target.

  • 05

    Can the AI delete my social media posts?

    No. The tools are read-only and cannot perform any actions on your accounts.

  • More questions about Crawlbase? The Connector page answers them. See everything the Crawlbase Connector can do

Connect Crawlbase to Claude, Cursor, ChatGPT & more