• ANALYSIS
  • CONTEXT
  • SUMMARY
  • HUMAN

How to debug failed test steps with your AI

Connect Xray to your AI client once. From there, you can ask your agent to find the specific reason a test run failed.

Ask AI about this page

Short answer

How do I find exactly which test step failed?

Your AI uses the Xray Connector to pull the specific execution details for a test run. It identifies the failed step and the error message so you can see the exact point of failure. You'll get a clear breakdown of the issue.

The outcomes.

Where your data lands.

Your AI handles the data retrieval so you can focus on the fix.

ANALYSIS

Pinpoint the failure

The AI scans the execution data to find the exact step that failed. You get the step name and the error message immediately.

CONTEXT

See step results

Your agent pulls the expected and actual results for the failed step. This shows you exactly where the logic diverged.

SUMMARY

Get a clear report

The AI condenses the technical failure into a plain explanation. You can use this to explain the bug to others.

HUMAN

Decide the fix

The AI finds the error, but you decide if it's a real bug or a flaky test. You make the final call on how to fix it.

The workflow

What your AI does when a test fails.

The AI acts as the bridge between your Xray logs and your chat window.

  1. Fetch execution data

    Your agent pulls the full execution details for a specific test run from Xray.

    get_execution_details

  2. Identify failed steps

    The AI looks through the retrieved data to find which specific step failed.

    get_execution_details

  3. Compare results

    It checks the expected results against the actual results for that step.

    get_execution_details

  4. Explain the error

    The AI summarizes the failure so you understand the root cause.

    get_execution_details

Try it

Copy these to start.

Use these prompts to start debugging.

Starting points

Replace the bracketed text with your actual Xray execution IDs or test names.

Xray (Test Management) Connector

You're all set. Choose your MCP client and follow the setup instructions.

Connector linkhttps://edge.vinkius.com/vk_preview_wm1FHp5m3EdTrKq9bAVa09Uad6Q4L0EjAfSyNZ5Y/mcp

Claude Desktop

Follow the steps below to connect in seconds.

  1. 1In Claude Desktop, open Settings → Connectors.
  2. 2Click “Add custom connector” and paste the connector link above as the remote MCP server URL.
  3. 3Click Add and start a new chat — Xray (Test Management) capabilities are ready to use.
Configuration · claude_desktop_config.jsonCopy
{
  "mcpServers": {
    "xray-test-management-mcp": {
      "url": "https://edge.vinkius.com/vk_preview_wm1FHp5m3EdTrKq9bAVa09Uad6Q4L0EjAfSyNZ5Y/mcp"
    }
  }
}
Copy into chat04

  • Show me the failed steps for Xray execution ID 5501.

  • Why did the 'Payment Gateway' test fail in the last run?

  • What was the error message for the failed step in execution 9928?

  • Find the failed steps for the 'User Authentication' test run.

  • Claude
  • ChatGPT
  • Cursor
  • VS Code
  • Windsurf
  • Claude Code
  • JetBrains
  • Cline

Start here

Connect Xray once, then ask.

Link your Xray account through Vinkius. Your credentials stay encrypted, and you can immediately start asking your agent about your test runs.

Connect Xray to your AI

FAQ

How this task behaves

  • 01

    Can the AI fix the failed test for me?

    No. The AI only reads the execution details to tell you what happened. You have to manually fix the test in Xray.

  • 02

    Can the AI delete test executions?

    No. The AI only has permission to read data using get_execution_details; it cannot delete or modify anything in Xray.

  • 03

    Does the AI need my Xray login?

    No. You connect via Vinkius, which keeps your credentials encrypted and secure.

  • 04

    Can I use this with Cursor or Claude?

    Yes. You can use this with any MCP-compatible client.

  • 05

    Can the AI create new test cases?

    No. This specific task is limited to retrieving execution details for debugging.

  • More questions about Xray? The Connector page answers them. See everything the Xray Connector can do

Connect Xray (Test Management) to Claude, Cursor, ChatGPT & more