• LOGIC
  • ACCURACY
  • RELIABILITY
  • HUMAN

How to test chatbot responses with your AI

Connect Chatfly to your AI client once. From there, you can trigger bot interactions and check their answers without leaving your chat window.

Ask AI about this page

Short answer

How can I test my Chatfly bot using my AI?

You can list your active bots and send them messages through your AI client to see how they react. This lets you verify their logic and accuracy in real time. You'll see the specific outcomes of these tests below.

Testing outcomes

What you get from testing

Running these tests gives you clear visibility into how your bots behave.

LOGIC

Verify bot reasoning

The AI sends a message and shows you the bot's reply. You'll see if the bot follows your intended conversation paths.

ACCURACY

Check factual correctness

Your agent acts as a user to probe the bot for specific info. You'll know immediately if the bot provides correct data.

RELIABILITY

Find edge cases

By sending unexpected inputs, you find where the bot's logic breaks. This helps you fix issues before users see them.

HUMAN

Manual fixes needed

If a bot fails a test, you'll need to go into the Chatfly dashboard to adjust the bot's settings or instructions.

The workflow

What your AI does when <the thing arrives>.

Your AI handles the heavy lifting of communicating with the Chatfly platform.

  1. Find your bots

    The AI pulls a list of your available Chatfly bots so you can select the right one to test.

    list_chatfly_bots

  2. Deliver the prompt

    The AI sends your specific test message to the bot you chose.

    send_bot_message

  3. Receive the reply

    The AI captures the bot's response and presents it to you in your chat window.

    send_bot_message

  4. Evaluate the result

    The AI compares the bot's answer against your instructions to see if it passed.

    send_bot_message

Try it

Copy these to start.

Use these prompts to begin testing your bots immediately.

Starting points

These are opening lines. Replace the bot names with your actual Chatfly bot IDs.

CHATFLY Connector

You're all set. Choose your MCP client and follow the setup instructions.

Connector linkhttps://edge.vinkius.com/vk_preview_g5Jpcnhe3wKDzdOk7FPTVWgbtYJ0bn7BpbvqugJz/mcp

Claude Desktop

Follow the steps below to connect in seconds.

  1. 1In Claude Desktop, open Settings → Connectors.
  2. 2Click “Add custom connector” and paste the connector link above as the remote MCP server URL.
  3. 3Click Add and start a new chat — CHATFLY capabilities are ready to use.
Configuration · claude_desktop_config.jsonCopy
{
  "mcpServers": {
    "chatfly-mcp": {
      "url": "https://edge.vinkius.com/vk_preview_g5Jpcnhe3wKDzdOk7FPTVWgbtYJ0bn7BpbvqugJz/mcp"
    }
  }
}
Copy into chat04

  • List my Chatfly bots so I can see which ones are ready to test.

  • Send a message to 'Support_Bot_01' asking about shipping times and tell me what it says.

  • Test the 'Billing_Bot' by asking if I can change my credit card on file.

  • Ask 'Lead_Gen_Bot' for a demo to see if it captures my contact info correctly.

  • Claude
  • ChatGPT
  • Cursor
  • VS Code
  • Windsurf
  • Claude Code
  • JetBrains
  • Cline

Start here

Connect CHATFLY once, then ask.

Connect via the link below. Your login stays encrypted on our side, and you can start testing immediately.

Connect CHATFLY to your AI

FAQ

How testing works

  • 01

    Can my AI change the bot's logic?

    No. The AI can only send messages and list bots. You must use the Chatfly dashboard to edit bot settings.

  • 02

    Can the AI delete my bots?

    No. This MCP does not have any tools for deleting or modifying your Chatfly bots.

  • 03

    Will these test messages appear in my Chatfly logs?

    Yes. Every message sent by your AI is a real interaction that shows up in your Chatfly history.

  • 04

    How do I know which bot ID to use?

    Ask your AI to list your bots first. It will provide the IDs you need to send messages.

  • 05

    Can I test a bot that isn't listed?

    No. The AI can only interact with bots that appear when you use the list tool.

  • More questions about CHATFLY? The Connector page answers them. See everything the CHATFLY Connector can do

Connect CHATFLY to Claude, Cursor, ChatGPT & more