Can the AI change the vendor's documentation?

No. The AI only reads the documentation to extract claims; it cannot edit or modify the original files.

Does the AI perform the physical testing itself?

The AI designs and manages the logic of the experiment, but you must provide the environment or hardware being tested.

Can I use this to verify claims in a spreadsheet?

Yes, if the spreadsheet contains the technical specifications you want to test.

Will the AI automatically send a complaint to the vendor?

No. The AI only generates the data and reports. You are responsible for any communication with the vendor.

Does the AI delete my test data after it finishes?

No. The AI processes the data to provide the report, but it does not have the capability to delete your files or test results.

AUDITTESTREPORTHUMAN

AUDIT
TEST
REPORT
HUMAN

How to verify vendor performance claims with your AI

Connect Galileo Experimental Prover to your AI client to turn static vendor PDFs into testable hypotheses.

Ask AI about this page

Short answer

How can I use my AI to check if a vendor is telling the truth?

Your AI reads the vendor's technical documentation and identifies specific performance claims. It then uses the Galileo Experimental Prover to design and run controlled tests that validate those exact metrics. You get a clear report showing where the documentation matches reality and where it fails.

The results of an audit.

Where your findings land.

Once the AI finishes the validation, you'll have these specific outputs.

AUDIT

Claim extraction

The AI parses technical manuals to pull out every measurable performance promise. You get a clean list of targets to test.

TEST

Controlled validation

The AI builds a test environment to stress the vendor's hardware or software. It isolates variables to ensure the results are accurate.

REPORT

Discrepancy mapping

You receive a comparison between the vendor's stated specs and the actual test data. This highlights exactly where they overpromised.

HUMAN

Final decision

The AI provides the data, but you decide if the performance meets your requirements. You use the findings to negotiate or walk away.

The workflow

What your AI does when the documentation arrives.

The AI handles the heavy lifting of data parsing and test design.

Extract claims
The AI scans your uploaded vendor documents to find specific, measurable performance metrics.
validate_galileo_experiment
Design tests
It creates a structured experiment designed to trigger the specific conditions mentioned in the documentation.
validate_galileo_experiment
Execute validation
The AI runs the experiment and collects raw data from the controlled environment.
validate_galileo_experiment
Compare results
The AI matches the experimental data against the original claims to find gaps.
validate_galileo_experiment

Try it

Copy these to start.

Use these prompts to kick off your first audit.

Starting points

Swap the bracketed text for your actual files or specific vendor names.

Galileo Experimental Prover Connector

You're all set. Choose your MCP client and follow the setup instructions.

Connector linkhttps://edge.vinkius.com/vk_preview_isqYV5nylEKAxwmBsGWpbc0CJmDH7Xhz0HL04bd3/mcp

Claude Desktop

Follow the steps below to connect in seconds.

1In Claude Desktop, open Settings → Connectors.
2Click “Add custom connector” and paste the connector link above as the remote MCP server URL.
3Click Add and start a new chat — Galileo Experimental Prover capabilities are ready to use.

Configuration · claude_desktop_config.jsonCopy

{
  "mcpServers": {
    "galileo-experimental-prover-mcp": {
      "url": "https://edge.vinkius.com/vk_preview_isqYV5nylEKAxwmBsGWpbc0CJmDH7Xhz0HL04bd3/mcp"
    }
  }
}

Copy into chat04

Read this vendor PDF and list every performance claim that can be measured.
Based on the specs in this technical manual, design a test to verify the latency claims.
Run a validation experiment on the throughput numbers found in the attached datasheet.
Compare the results from my last test against the claims in the Acme Corp documentation.

Claude
ChatGPT
Cursor
VS Code
Windsurf
Claude Code
JetBrains
Cline

Start here

Connect Galileo Experimental Prover once, then ask.

One click connects this MCP to your AI client. Your credentials stay encrypted, and you can start auditing immediately.

Connect Galileo Experimental Prover to your AI

FAQ

How the verification process works

01
Can the AI change the vendor's documentation?
No. The AI only reads the documentation to extract claims; it cannot edit or modify the original files.
02
Does the AI perform the physical testing itself?
The AI designs and manages the logic of the experiment, but you must provide the environment or hardware being tested.
03
Can I use this to verify claims in a spreadsheet?
Yes, if the spreadsheet contains the technical specifications you want to test.
04
Will the AI automatically send a complaint to the vendor?
No. The AI only generates the data and reports. You are responsible for any communication with the vendor.
05
Does the AI delete my test data after it finishes?
No. The AI processes the data to provide the report, but it does not have the capability to delete your files or test results.
More questions about Galileo Experimental Prover? The Connector page answers them. See everything the Galileo Experimental Prover Connector can do

Connect Galileo Experimental Prover to Claude, Cursor, ChatGPT & more