Skip to content
Vinkius

Firecrawl Connector for AI agents.

6 live capabilities

Turn websites into clean markdown for RAG pipelines.

Live agent request Firecrawl / Connector

Waiting for input…

AI Agent

Why people use Firecrawl

Firecrawl Web Scraping for RAG Pipelines

This Connector changes that by handling the heavy lifting of JavaScript rendering and boilerplate removal. You just point your agent at a URL and get back clean markdown ready for your vector database.

  • Claude
  • ChatGPT
  • Gemini
  • Cursor
  • Visual Studio Code
  • Windsurf

What Vinkius changes

You get high-quality web data in a format your AI can actually read without any manual cleanup.

Use it from Claude, ChatGPT, Cursor or another AI client you already have.

One account · 5,900+ Connectors

  1. Real-world use case 01

    Building a RAG knowledge base

    A developer needs to feed 500 documentation pages into a vector store.

  2. Real-world use case 02

    Automated market research

    An analyst needs to monitor a competitor's pricing across 50 pages.

  3. Real-world use case 03

    Content curation

    A blogger wants to convert a long-form article into a markdown blog post.

Complete set · 6capabilities

The complete Firecrawl capability set.

These are the exact actions your AI can choose when you ask it to work with Firecrawl.

Capability set01 / 02

01—03

3 capabilities in this set.

Part of 6 available through Firecrawl.

  1. 01 Capability

    Get api usage

    Check your current Firecrawl credit balance. This helps you track your spending and remaining limits in real time.

  2. 02 Capability

    Cancel active crawl

    Stop a crawl job that's currently running. Use this if a task is taking too long or you need to halt a process immediately.

  3. 03 Capability

    Get crawl status

    Check the progress of a specific crawl job. This tells you if the job is still running, finished, or failed.

Capability set02 / 02

04—06

3 capabilities in this set.

Part of 6 available through Firecrawl.

  1. 04 Capability

    Start crawl

    Start a recursive crawl of a whole website to find all subpages. It returns a job ID so you can track the progress as it builds your knowledge base.

  2. 05 Capability

    Map website structure

    Identify every reachable link on a domain without downloading the content. This is great for understanding a site's hierarchy before you start scraping.

  3. 06 Capability

    Scrape url

    Turn a single URL into clean markdown. It automatically removes boilerplate like headers and footers so the data is ready for your agent to use.

Set up in minutes

One URL. Then ask Firecrawl to work.

Claude and ChatGPT only need the Connector URL. Copy it once, add it in settings, and use Firecrawl from the conversation.

Choose your client

Live preview
Advanced clients IDE · CLI

Claude · Web + desktop

Official guide ↗

Connector URL · ready to paste

Streamable HTTP
https://edge.vinkius.com/vk_preview_VUpOJRFVTRGTwbzAMeVqIv4t7KoCrITMFS6MmDGP/mcp
  1. Step 01

    Open Connectors

    In Claude Web or Claude Desktop, open Settings and choose Connectors.

  2. Step 02

    Add the URL

    Choose Add custom connector, name it Firecrawl, and paste the URL above.

  3. Step 03

    Turn it on in chat

    Select +, open Connectors, and enable Firecrawl for the conversation.

Where the request belongs

Work Firecrawl can move forward.

Built around the request

This is for AI developers building RAG systems, research teams gathering market intelligence, and content creators who need to convert web data into structured text.

01

AI Developer

Building a RAG pipeline and needing to ingest clean documentation from a site without writing custom scrapers.

02

Market Researcher

Automating the collection of competitor pricing and news across multiple web pages.

03

Content Creator

Converting long-form web articles into clean markdown for newsletters or blog posts.

Bring your own AI

Change the model, client or framework. Keep Firecrawl connected.

  • Claude
  • ChatGPT
  • Gemini
  • Cursor
  • VS Code
  • Windsurf
  • ZCode
  • Cline
  • Zed
  • Continue
  • Kiro
  • Roo Code
  • Zencoder
  • Goose
  • Void
  • Augment Code
  • Amp
  • Qodo
  • Tabnine
  • Pieces
  • Sourcegraph Cody
  • JetBrains
  • Warp
  • Amazon Q
  • Antigravity
  • BoltAI
  • Raycast
  • Jan
  • LM Studio
  • AnythingLLM
  • Open WebUI
  • Msty
  • Cherry Studio
  • LibreChat
  • TypingMind
  • Chorus
  • 5ire
  • n8n
  • LangChain
  • LlamaIndex
  • CrewAI
  • Vercel AI SDK

Before you connect

Questions about Firecrawl.

The practical details behind the request, access and result.

Can Firecrawl scrape websites that use JavaScript?

Yes, this Connector handles JavaScript rendering automatically, so it can scrape modern web apps that wouldn't work with basic scrapers.

How does Firecrawl handle messy HTML like headers and footers?

It automatically strips out boilerplate content like navigation menus and footers, giving you clean markdown that's ready for your AI to read.

Can I use Firecrawl to build a RAG pipeline?

That's a primary use case. You can crawl entire websites to build comprehensive knowledge bases for your RAG applications.

How do I see how many credits I have left?

You can ask your agent to check your Firecrawl credit usage at any time to see your remaining limits and active jobs.

Can I stop a crawl if it's taking too long?

Yes, you can tell your agent to cancel an active crawl job immediately to save your credits.

What is the difference between scraping a URL and crawling a site?

Scraping a URL gets data from a single page, while crawling a site follows every link on a domain to gather data from every subpage.

How do I find my Firecrawl API Key?

Log in to your Firecrawl dashboard, and navigate to the API Keys section to copy your unique token.

Can I scrape content excluding headers and footers?

Yes! The scrape_url capability includes an onlyMainContent parameter. When set to true, Firecrawl uses AI to extract only the core article or page content.

How long does a recursive crawl take?

Crawl time depends on the site size and depth. Use the get_crawl_status capability to monitor progress and retrieve results once the job is complete.

One connection away

Give your agent a direct line to Firecrawl.

Connect Firecrawl once. Keep it beside 5,900+ managed Connectors when the next task needs more.

Explore every Connector No credit card required · Free tier available