- FAIL
- PASS
- HUMAN
- LOG
Short answer
How can I check if my API matches my design?
Your AI uses Apiary to run automated tests against your current blueprints. It identifies exactly where your implementation deviates from your specification. You get a clear list of broken contracts and design mismatches.
Test outcomes.
Where your results land.
The AI processes the test runs and organizes the findings into these categories.
FAIL
Broken contracts
The AI identifies specific endpoints where the implementation fails the blueprint. You get the exact reason the request or response didn't match.
PASS
Verified endpoints
The AI confirms which parts of your API are behaving exactly as designed. This gives you confidence to move to the next feature.
HUMAN
Design decisions
When a test fails because the design itself is flawed, the AI flags it for you. You decide if the code is wrong or if the blueprint needs an update.
LOG
Test history
The AI tracks the results of your runs. You can review previous validation attempts to see if recent changes broke existing specs.
The workflow
What your AI does when the blueprint arrives.
The AI handles the heavy lifting of execution and comparison.
Load the blueprint
Your agent pulls the latest API design from your Apiary project to establish the source of truth.
run_testsExecute validation
The AI triggers automated test suites that hit your live endpoints using the rules defined in the spec.
run_testsCompare results
The agent compares the actual HTTP responses against the expected schema from the blueprint.
run_testsReport mismatches
The AI summarizes the discrepancies, highlighting missing fields or incorrect data types.
run_tests
Try it
Copy these to start.
Use these prompts to kick off your first validation run.
Starting points
Swap the bracketed text with your specific project names or endpoint URLs.
Apiary Connector
You're all set. Choose your MCP client and follow the setup instructions.
https://edge.vinkius.com/vk_preview_UAsHBD3gjamXcRpVpwIeIHmn77OKcfcfMA4F8oBO/mcpClaude Desktop
Follow the steps below to connect in seconds.
- 1In Claude Desktop, open Settings → Connectors.
- 2Click “Add custom connector” and paste the connector link above as the remote MCP server URL.
- 3Click Add and start a new chat — Apiary capabilities are ready to use.
{
"mcpServers": {
"apiary-mcp": {
"url": "https://edge.vinkius.com/vk_preview_UAsHBD3gjamXcRpVpwIeIHmn77OKcfcfMA4F8oBO/mcp"
}
}
}Run tests against my 'User-Service' blueprint in Apiary.
Check if my current implementation matches the 'Payments-API' spec.
Validate the endpoints in my 'Auth-Module' blueprint and tell me what failed.
Run a test suite against the 'Inventory-API' and summarize the mismatches.
Claude
ChatGPT
Cursor
VS Code
Windsurf
Claude Code
JetBrains
Cline
Start here
Connect Apiary once, then ask.
Just link your Apiary account. Your credentials stay encrypted, and you can immediately start asking your agent to run tests.
Connect Apiary to your AIFAQ
How this task behaves.
- 01
Can the AI change my API design?
No. The AI only reads your blueprints to run tests. It cannot modify your Apiary specifications or your code.
- 02
Does the AI deploy code?
No. The AI only runs tests against existing implementations. It doesn't have the ability to push code or deploy services.
- 03
What happens if a test fails?
The AI reports the specific mismatch, such as a missing field or a type error, so you can fix it.
- 04
Can I run tests on a specific endpoint?
Yes. You can tell your agent to target a specific part of your blueprint rather than the whole thing.
- 05
How does the AI know which API to test?
It uses the blueprints you have connected via Apiary to identify the expected behavior and endpoints.
More questions about Apiary? The Connector page answers them. See everything the Apiary Connector can do
Connect Apiary to Claude, Cursor, ChatGPT & more
