Arize AI Connector for AI agents.
6 live capabilities
Monitor LLM performance and track data drift in real-time.
Waiting for input…
Why people use Arize AI
Arize AI for ML Observability and Drift Tracking
This Connector cuts that cycle. You can ask your agent to pull specific metrics or list your environments directly in your workspace. You get a real-time view of your model's health without ever opening a separate tab.
What Vinkius changes
You get a hands-off way to manage ML observability through natural conversation.
Use it from Claude, ChatGPT, Cursor or another AI client you already have.
One account · 5,900+ Connectors
- Real-world use case 01
Detecting Sudden Drift
An engineer notices weird outputs and asks the agent to check `get_metrics` for the production model to see if data drift is the cause.
- Real-world use case 02
Safety and Toxicity Audits
A PM asks the agent to `list_evals` to see if the latest batch of prompts passed the toxicity and hallucination checks.
- Real-world use case 03
Automated Log Ingestion
A developer wants to push a batch of mocked responses and uses `ingest_log` to send them to Arize without opening a browser.
Complete set · 6capabilities
The complete Arize AI capability set.
These are the exact actions your AI can choose when you ask it to work with Arize AI.
01—03
3 capabilities in this set.
Part of 6 available through Arize AI.
- 01 Capability
List datasets
List all static evaluation datasets available to you. This helps you see what benchmarks are ready for testing.
- 02 Capability
Create dataset
Create a dataset
- 03 Capability
Get model
Fetch details and metadata for a specific tracked model. You can see the inputs, outputs, and features for any model in your space.
04—06
3 capabilities in this set.
Part of 6 available through Arize AI.
- 04 Capability
List experiments
List experiments
- 05 Capability
List projects
List projects
- 06 Capability
List spans
List spans
Set up in minutes
One URL. Then ask Arize AI to work.
Claude and ChatGPT only need the Connector URL. Copy it once, add it in settings, and use Arize AI from the conversation.
Choose your client
Live previewAdvanced clients IDE · CLI
Claude · Web + desktop
Connector URL · ready to paste
Streamable HTTPhttps://edge.vinkius.com/vk_preview_wKJSgGsb2EgJmks5PzM3V0jknb7nFZgbwB0CaRFP/mcp - Step 01
Open Connectors
In Claude Web or Claude Desktop, open Settings and choose Connectors.
- Step 02
Add the URL
Choose Add custom connector, name it Arize AI, and paste the URL above.
- Step 03
Turn it on in chat
Select +, open Connectors, and enable Arize AI for the conversation.
ChatGPT · Web + desktop
Connector URL · ready to paste
Streamable HTTPhttps://edge.vinkius.com/vk_preview_wKJSgGsb2EgJmks5PzM3V0jknb7nFZgbwB0CaRFP/mcp - Step 01
Open MCP settings
On desktop, open Settings and MCP servers. On web, open your workspace app or connector settings.
- Step 02
Add the URL
Choose Add server with Streamable HTTP, or create a custom MCP app, then paste the Arize AI URL.
- Step 03
Save and start
Save the connection and enable Arize AI in your conversation. Desktop may ask you to restart once.
Cursor · IDE configuration
Advanced setup
{
"mcpServers": {
"arize-ai": {
"url": "https://edge.vinkius.com/vk_preview_wKJSgGsb2EgJmks5PzM3V0jknb7nFZgbwB0CaRFP/mcp"
}
}
} - Step 01
Open MCP Settings
Press Cmd+Shift+P (macOS) or Ctrl+Shift+P (Windows/Linux) → search "MCP Settings"
- Step 02
Add the server config
Paste the JSON configuration above into the mcp.json file that opens
- Step 03
Save the file
Cursor will automatically detect the new Connector
- Step 04
Start using Arize AI
Open Agent mode in chat and ask: "Using Arize AI, help me...". 6 tools available
VS Code Copilot · IDE configuration
Advanced setup
{
"mcpServers": {
"arize-ai": {
"url": "https://edge.vinkius.com/vk_preview_wKJSgGsb2EgJmks5PzM3V0jknb7nFZgbwB0CaRFP/mcp"
}
}
} - Step 01
Create MCP config
Create a .vscode/mcp.json file in your project root
- Step 02
Add the server config
Paste the JSON configuration above
- Step 03
Enable Agent mode
Open GitHub Copilot Chat and switch to Agent mode using the dropdown
- Step 04
Start using Arize AI
Ask Copilot: "Using Arize AI, help me...". 6 tools available
Windsurf · IDE configuration
Advanced setup
{
"mcpServers": {
"arize-ai": {
"url": "https://edge.vinkius.com/vk_preview_wKJSgGsb2EgJmks5PzM3V0jknb7nFZgbwB0CaRFP/mcp"
}
}
} - Step 01
Open MCP Settings
Go to Settings → MCP Configuration or press Cmd+Shift+P and search "MCP"
- Step 02
Add the server
Paste the JSON configuration above into mcp_config.json
- Step 03
Save and reload
Windsurf will detect the new server automatically
- Step 04
Start using Arize AI
Open Cascade and ask: "Using Arize AI, help me...". 6 tools available
Cline · IDE configuration
Advanced setup
{
"mcpServers": {
"arize-ai": {
"url": "https://edge.vinkius.com/vk_preview_wKJSgGsb2EgJmks5PzM3V0jknb7nFZgbwB0CaRFP/mcp"
}
}
} - Step 01
Open Cline MCP Settings
Click the Connectors icon in the Cline sidebar panel
- Step 02
Add remote server
Click "Add Connector" and paste the configuration above
- Step 03
Enable the server
Toggle the server switch to ON
- Step 04
Start using Arize AI
Ask Cline: "Using Arize AI, help me...". 6 tools available
Claude Code · Terminal command
Advanced setup
claude mcp add arize-ai --transport http "https://edge.vinkius.com/vk_preview_wKJSgGsb2EgJmks5PzM3V0jknb7nFZgbwB0CaRFP/mcp" - Step 01
Install Claude Code
Run npm install -g @anthropic-ai/claude-code if not already installed
- Step 02
Add the Connector
Run the command above in your terminal
- Step 03
Verify the connection
Run claude mcp to list connected servers, or type /mcp inside a session
- Step 04
Start using Arize AI
Ask Claude: "Using Arize AI, show me...". 6 tools are ready
Where the request belongs
Work Arize AI can move forward.
The ML engineer who's tired of manually pushing telemetry logs and checking for drift in a separate tab, or the PM who needs to monitor output toxicity across five different LLM integrations.
ML Engineer
Uses the Connector to push inference telemetry and check for performance degradation flags without leaving the terminal.
AI Product Manager
Monitors output toxicity, drift rates, and usage metrics across multiple LLM integrations to ensure safety.
Data Scientist
Manages baseline evaluation datasets and triggers custom scoring loops asynchronously during model development.
Build the capability set
Add more capabilities.
Each Connector adds new actions and data without changing how you work.
Browse ConnectorsArize AI
Monitor ML model performance, detect data drift, and troubleshoot prediction quality with real-time observability dashboards.
DataRobot
Manage AutoML via DataRobot. monitor projects and models, track deployments, and audit ML datasets directly from any AI agent.
H2O.ai
Manage AI models via H2O.ai. track data frames, monitor machine learning models and training jobs, and audit cloud cluster status directly from any AI agent.
Abacus AI (Enterprise AI Cloud)
Manage the full machine learning lifecycle via Abacus AI. create projects, train models, and deploy real-time prediction endpoints.
Comet ML
Manage machine learning experiments via Comet. track model metrics, audit project workspaces, and inspect ML run parameters directly from any AI agent.
Modelbit (ML Model Deployments)
Deploy and call machine learning models directly from your AI agent using Modelbit's inference endpoints.
Bring your own AI
Change the model, client or framework. Keep Arize AI connected.
-
Claude -
ChatGPT -
Gemini -
Cursor -
VS Code -
Windsurf -
ZCode -
Cline -
Zed -
Continue -
Kiro -
Roo Code -
Zencoder -
Goose -
Void -
Augment Code -
Amp -
Qodo -
Tabnine -
Pieces -
Sourcegraph Cody -
JetBrains -
Warp -
Amazon Q -
Antigravity -
BoltAI -
Raycast -
Jan -
LM Studio -
AnythingLLM -
Open WebUI -
Msty -
Cherry Studio -
LibreChat -
TypingMind -
Chorus -
5ire -
n8n -
LangChain -
LlamaIndex -
CrewAI -
Vercel AI SDK
Before you connect
Questions about Arize AI.
The practical details behind the request, access and result.
How does Arize AI help with LLM hallucination?
It allows you to run automated evaluations against your logs and static datasets. You can use your agent to trigger these checks and see if your model is producing accurate or hallucinated content.
Can I use Arize AI to monitor data drift?
Yes. You can ask your agent to fetch real-time metrics for any tracked model to see if your data quality or prediction distributions have shifted.
How do I push logs to Arize using an agent?
You can simply tell your agent to push specific telemetry logs or prediction data. It will structure the logs correctly and send them to your Arize platform for analysis.
Does Arize AI support multi-environment tracking?
Yes, it can list and manage different environments like production, training, and verification. This helps you keep your monitoring organized across different deployment stages.
Can my agent run automated evaluations?
Absolutely. You can trigger custom evaluation runs for things like toxicity, PII filtering, and hallucination checks directly through a natural language command.
How do I see which models are currently tracked?
Just ask your agent to list your models. It will pull a list of all ML models and LLMs currently being monitored in your Arize spaces.
Can my AI automatically trigger a hallucination evaluation on a new dataset?
Yes! You can ask your agent to retrieve the specific Ground Truth dataset ID, formulate a testing payload, and invoke the run_eval capability natively. Arize will process the asynchronous scoring internally and log the evaluation securely.
How can I quickly check if a production model is experiencing data drift?
Just tell your agent: 'Fetch the primary metrics for model X'. The AI uses the get_metrics query to immediately surface latency degradation, prediction drift flags, and incoming data quality indexes without opening the browser.
Is it possible to track telemetry simultaneously for both local development and production environments?
Absolutely. Arize enforces strict separation using Spaces and Environments. You can instruct your AI agent to query the list_environments capability, figure out the sandbox ID, and push manual test logs strictly to the sandbox scope during debugging sessions, keeping production metrics clean.
How do I find my Arize API Key?
Log in to your account, navigate to Settings > API, and generate or copy your unique secret key.
Can I track model drift via AI?
Yes! Use the list_experiments capability to retrieve data on active model evaluations and track performance variations programmatically.
How do I retrieve telemetry traces?
Use the list_spans capability to retrieve high-fidelity execution spans and traces for your ML projects directly from the platform.
One connection away
Give your agent a direct line to Arize AI.
Connect Arize AI once. Keep it beside 5,900+ managed Connectors when the next task needs more.
Explore every Connector No credit card required · Free tier available