• RUNNING
  • SUCCESS
  • FAILURE
  • HUMAN

How to trigger test suite runs with your AI

Connect ContextQA to your agent to turn natural language commands into active test executions.

Ask AI about this page

Short answer

How can I run tests using my AI?

You tell your agent which project and suite to use, then specify the target environment. It handles the lookup and execution in ContextQA, giving you the results once the run finishes.

Test execution outcomes

Where your runs land.

The different states your test execution enters.

RUNNING

Active execution

The AI triggers the suite and the run starts. You can ask your agent for status updates while it works.

SUCCESS

Passed tests

The suite finishes without errors. Your AI confirms the environment is stable and ready for the next step.

FAILURE

Test regressions

The run hits a failure. Your AI identifies which suite failed so you can investigate the specific environment.

HUMAN

Manual review

If a run fails or an environment is unreachable, the AI stops and asks you to step in and check the logs.

The workflow

What your AI does when the command arrives.

Your agent handles the navigation and execution steps in ContextQA.

  1. Locate the project

    The AI looks through your ContextQA account to find the right project container.

    list_projects
  2. Find the suite

    It scans the selected project to identify the specific test suite you want to run.

    list_suites
  3. Select the target

    The agent checks which environments are available to ensure the run hits the right target.

    list_environments
  4. Launch the run

    The AI sends the final command to start the execution against the chosen environment.

    trigger_run

Try it

Copy these to start.

Use these prompts to kick off your first test run.

Starting points

Swap out the project and suite names with your actual ContextQA identifiers.

ContextQA Connector

You're all set. Choose your MCP client and follow the setup instructions.

Connector linkhttps://edge.vinkius.com/vk_preview_arIg6fOatFWYf4ywr6Asm6h013dTDEa83NCzuGoP/mcp

Claude Desktop

Follow the steps below to connect in seconds.

  1. 1In Claude Desktop, open Settings → Connectors.
  2. 2Click “Add custom connector” and paste the connector link above as the remote MCP server URL.
  3. 3Click Add and start a new chat — ContextQA capabilities are ready to use.
Configuration · claude_desktop_config.jsonCopy
{
  "mcpServers": {
    "contextqa-mcp": {
      "url": "https://edge.vinkius.com/vk_preview_arIg6fOatFWYf4ywr6Asm6h013dTDEa83NCzuGoP/mcp"
    }
  }
}
Copy into chat04
  • Run the 'Sanity Check' suite in the 'Mobile App' project on the staging environment.

  • Show me all the test suites available in my 'Web Portal' project.

  • Trigger a run for the 'API Regression' suite against the production environment.

  • List all my projects in ContextQA so I can pick one to test.

  • Claude
  • ChatGPT
  • Cursor
  • VS Code
  • Windsurf
  • Claude Code
  • JetBrains
  • Cline

Start here

Connect ContextQA once, then ask.

Follow the link to authorize the connection. Your credentials stay encrypted and you can start prompting immediately.

Connect ContextQA to your AI

FAQ

How this task behaves

  • 01

    Can my AI create new test suites?

    No. The AI can only list and trigger existing suites.

  • 02

    Can the AI delete my test results?

    No. The AI has no tools to delete or modify existing data or results.

  • 03

    How does the AI know which environment to use?

    It uses the list_environments tool to see what is available, then you specify the target in your prompt.

  • 04

    Can I ask the AI to change the test code?

    No. This connector is for executing and managing runs, not for editing test logic.

  • 05

    Does the AI run tests automatically?

    No. The AI only triggers a run when you explicitly ask it to via a prompt.

  • More questions about ContextQA? The Connector page answers them. See everything the ContextQA Connector can do

Connect ContextQA to Claude, Cursor, ChatGPT & more