• DATA
  • VECTOR
  • LIST
  • HUMAN

How to debug RAG retrieval accuracy with your AI

Connect FastGPT to your AI client to inspect the raw data driving your responses. You'll see exactly which chunks are being pulled during a search.

Ask AI about this page

Short answer

How can I check why my AI is retrieving specific data?

You can run semantic searches and inspect the specific data chunks within your datasets to find mismatches. This lets you see the exact text your AI is looking at when it answers questions.

Debugging outcomes

Where your findings land.

The AI uses your FastGPT datasets to pinpoint retrieval errors.

DATA

Identify bad chunks

The AI pulls specific segments from your datasets. You'll see the exact text that triggered a retrieval match.

VECTOR

Check embedding math

The AI compares vector representations to see how closely a query matches your stored data.

LIST

Audit dataset structure

The AI scans your dataset organization to ensure the information is indexed correctly for retrieval.

HUMAN

Manual data cleanup

The AI identifies problematic segments, but you must go into FastGPT to edit or delete the source text.

The workflow

What your AI does when the debug request arrives.

Your agent moves through your FastGPT datasets to find the source of the retrieval error.

  1. Scan datasets

    The AI looks through your available FastGPT datasets to find the right source for your query.

    list_dataset_data

  2. Analyze embeddings

    The AI calculates the vector distance between your question and the stored data to see why a match occurred.

    get_embeddings

  3. Retrieve specific chunks

    The AI pulls the exact text segments that the semantic search identified as relevant.

    search_dataset_data

  4. Verify dataset metadata

    The AI checks the configuration and details of the dataset to ensure the indexing is correct.

    get_dataset_detail

Try it

Copy these to start.

Use these prompts to begin your debugging session.

Starting points

Replace the bracketed text with your actual FastGPT dataset names or specific query topics.

FastGPT Connector

You're all set. Choose your MCP client and follow the setup instructions.

Connector linkhttps://edge.vinkius.com/vk_preview_5ych6Vwp9PYj4HCpHT5jojSMb56573gZQlH3hDOl/mcp

Claude Desktop

Follow the steps below to connect in seconds.

  1. 1In Claude Desktop, open Settings → Connectors.
  2. 2Click “Add custom connector” and paste the connector link above as the remote MCP server URL.
  3. 3Click Add and start a new chat — FastGPT capabilities are ready to use.
Configuration · claude_desktop_config.jsonCopy
{
  "mcpServers": {
    "fastgpt-mcp": {
      "url": "https://edge.vinkius.com/vk_preview_5ych6Vwp9PYj4HCpHT5jojSMb56573gZQlH3hDOl/mcp"
    }
  }
}
Copy into chat04

  • Search the 'customer_support_v2' dataset for chunks related to refund policies.

  • List all data in my 'product_manual' dataset to see how it's organized.

  • Get the embeddings for this specific sentence to see how it maps to my data.

  • Check the details of the 'legal_docs' dataset to verify its configuration.

  • Claude
  • ChatGPT
  • Cursor
  • VS Code
  • Windsurf
  • Claude Code
  • JetBrains
  • Cline

Start here

Connect FastGPT once, then ask.

Just link your FastGPT account. Your credentials stay encrypted, and you can start debugging immediately.

Connect FastGPT to your AI

FAQ

How this task behaves.

  • 01

    Can the AI delete data from my FastGPT datasets?

    No. The AI can only read and search your data. You have to handle all deletions manually in FastGPT.

  • 02

    Can the AI change my embedding models?

    No. The AI can only retrieve existing embeddings to help you debug. It cannot modify your model settings.

  • 03

    How does the AI find the right data chunks?

    It uses semantic search to find text segments that are mathematically similar to your question.

  • 04

    Can I see the raw text of a chunk?

    Yes. The AI can pull the specific text segments that match your search queries.

  • 05

    Does the AI need my login password?

    No. You connect via a secure link, and your login details are never exposed to the AI.

  • More questions about FastGPT? The Connector page answers them. See everything the FastGPT Connector can do

Connect FastGPT to Claude, Cursor, ChatGPT & more