Ragas MCP Server for Windsurf 7 tools — connect in under 2 minutes
Windsurf brings agentic AI coding to a purpose-built IDE. Connect Ragas through Vinkius and Cascade will auto-discover every tool. ask questions, generate code, and act on live data without leaving your editor.
ASK AI ABOUT THIS MCP SERVER
Vinkius supports streamable HTTP and SSE.
Vinkius Desktop App
The modern way to manage MCP Servers — no config files, no terminal commands. Install Ragas and 2,500+ MCP Servers from a single visual interface.
{
"mcpServers": {
"ragas": {
"url": "https://edge.vinkius.com/[YOUR_TOKEN_HERE]/mcp"
}
}
}
* Every MCP server runs on Vinkius-managed infrastructure inside AWS - a purpose-built runtime with per-request V8 isolates, Ed25519 signed audit chains, and sub-40ms cold starts optimized for native MCP execution. See our infrastructure
About Ragas MCP Server
Integrate Ragas with your AI agent to bring professional grade RAG (Retrieval-Augmented Generation) evaluation and tracking into your chat interface. By subscribing to this server, the AI can seamlessly manage datasets and measure LLM performance on demand.
Windsurf's Cascade agent chains multiple Ragas tool calls autonomously. query data, analyze results, and generate code in a single agentic session. Paste Vinkius Edge URL, reload, and all 7 tools are immediately available. Real-time tool feedback appears inline, so you see API responses directly in your editor.
What you can do
- Dataset Management — Upload, list, and organize evaluation datasets directly inside your environment.
- Run Evaluations — Automatically trigger Ragas evaluations on your RAG pipelines and fetch detailed scoring.
- Track Experiments — Monitor and compare iterative improvements by viewing tracked metrics across different agent versions.
- Project Organization — Associate evaluations with specific projects within your Ragas dashboard.
The Ragas MCP Server exposes 7 tools through the Vinkius. Connect it to Windsurf in under two minutes — no API keys to rotate, no infrastructure to provision, no vendor lock-in. Your configuration, your data, your control.
How to Connect Ragas to Windsurf via MCP
Follow these steps to integrate the Ragas MCP Server with Windsurf.
Open MCP Settings
Go to Settings → MCP Configuration or press Cmd+Shift+P and search "MCP"
Add the server
Paste the JSON configuration above into mcp_config.json
Save and reload
Windsurf will detect the new server automatically
Start using Ragas
Open Cascade and ask: "Using Ragas, help me...". 7 tools available
Why Use Windsurf with the Ragas MCP Server
Windsurf provides unique advantages when paired with Ragas through the Model Context Protocol.
Windsurf's Cascade agent autonomously chains multiple tool calls in sequence, solving complex multi-step tasks without manual intervention
Purpose-built for agentic workflows. Cascade understands context across your entire codebase and integrates MCP tools natively
JSON-based configuration means zero code changes: paste a URL, reload, and all 7 tools are immediately available
Real-time tool feedback is displayed inline, so you see API responses directly in your editor without switching contexts
Ragas + Windsurf Use Cases
Practical scenarios where Windsurf combined with the Ragas MCP Server delivers measurable value.
Automated code generation: ask Cascade to fetch data from Ragas and generate models, types, or handlers based on real API responses
Live debugging: query Ragas tools mid-session to inspect production data while debugging without leaving the editor
Documentation generation: pull schema information from Ragas and have Cascade generate comprehensive API docs automatically
Rapid prototyping: combine Ragas data with Cascade's code generation to scaffold entire features in minutes
Ragas MCP Tools for Windsurf (7)
These 7 tools become available when you connect Ragas to Windsurf via MCP:
get_dataset
Retrieves details for a specific evaluation dataset
get_experiment
Retrieves detailed information for a specific experiment
get_results
Retrieves the results of a completed experiment
list_datasets
Lists available evaluation datasets
list_experiments
Lists experiments associated with a specific dataset
list_metrics
Lists all available evaluation metrics
run_evaluation
g., faithfulness, answer_relevancy). Triggers a new evaluation run for a dataset
Example Prompts for Ragas in Windsurf
Ready-to-use prompts you can give your Windsurf agent to start working with Ragas immediately.
"List all Ragas datasets available in my project."
"Fetch the metrics and results for the recent experiment 'Support Bot V3'."
"Create a new Ragas project named 'Financial_RAG_Testing'."
Troubleshooting Ragas MCP Server with Windsurf
Common issues when connecting Ragas to Windsurf through the Vinkius, and how to resolve them.
Server not connecting
Ragas + Windsurf FAQ
Common questions about integrating Ragas MCP Server with Windsurf.
How does Windsurf discover MCP tools?
mcp_config.json file on startup and connects to each configured server via Streamable HTTP. Tools are listed in the MCP panel and available to Cascade automatically.Can Cascade chain multiple MCP tool calls?
Does Windsurf support multiple MCP servers?
mcp_config.json. Each server's tools appear in the MCP panel and Cascade can use tools from different servers in a single flow.Connect Ragas with your favorite client
Step-by-step setup guides for every MCP-compatible client and framework:
Anthropic's native desktop app for Claude with built-in MCP support.
AI-first code editor with integrated LLM-powered coding assistance.
GitHub Copilot in VS Code with Agent mode and MCP support.
Purpose-built IDE for agentic AI coding workflows.
Autonomous AI coding agent that runs inside VS Code.
Anthropic's agentic CLI for terminal-first development.
Python SDK for building production-grade OpenAI agent workflows.
Google's framework for building production AI agents.
Type-safe agent development for Python with first-class MCP support.
TypeScript toolkit for building AI-powered web applications.
TypeScript-native agent framework for modern web stacks.
Python framework for orchestrating collaborative AI agent crews.
Leading Python framework for composable LLM applications.
Data-aware AI agent framework for structured and unstructured sources.
Microsoft's framework for multi-agent collaborative conversations.
Connect Ragas to Windsurf
Get your token, paste the configuration, and start using 7 tools in under 2 minutes. No API key management needed.