Compatible with every major AI agent and IDE
What is the Open WebUI MCP Server?
Connect your Open WebUI instance to any AI agent and take full control of your local and cloud LLM orchestration through natural conversation.
What you can do
- Model Management — Use
list_modelsto fetch all available models including Ollama, OpenAI, and Open WebUI Functions. - RAG & Knowledge Base — Upload files with
upload_file, process web content viaprocess_web_url, and organize them into collections usingadd_file_to_collection. - Chat Orchestration — Create and manage backend-controlled chats with
create_new_chator use OpenAI/Anthropic compatible endpoints likechat_completionsandsend_message. - Native Ollama Support — Directly interact with the Ollama API using
ollama_generate,ollama_tags, andollama_embedfor local inference tasks. - File Processing — Monitor the status of your document ingestion with
get_file_statusto ensure your RAG context is ready.
How it works
- Subscribe to this server
- Enter your Open WebUI Base URL and API Key
- Start managing your LLM infrastructure from Claude, Cursor, or any MCP-compatible client
Who is this for?
- AI Engineers — automate the testing of different models and RAG configurations without leaving the terminal or IDE.
- Knowledge Managers — quickly ingest documentation and web URLs into Open WebUI collections via simple commands.
- DevOps Teams — monitor local Ollama instances and manage model availability across the organization.
Built-in capabilities (12)
Add a file to a knowledge collection
Run outlet filters for completed chat
OpenAI-compatible chat completion
Must generate UUIDs for message IDs. Create a new chat (Backend-Controlled Flow)
Check file processing status
Retrieve all models
Ollama API Embeddings
Ollama API Generate Completion
List Ollama models
Process a web URL into a collection
Anthropic-compatible message generation
Content is extracted and stored in the vector DB. Provide file content as base64. Upload a file for RAG
Why LlamaIndex?
LlamaIndex agents combine Open WebUI tool responses with indexed documents for comprehensive, grounded answers. Connect 12 tools through Vinkius and query live data alongside vector stores and SQL databases in a single turn. ideal for hybrid search, data enrichment, and analytical workflows.
- —
Data-first architecture: LlamaIndex agents combine Open WebUI tool responses with indexed documents for comprehensive, grounded answers
- —
Query pipeline framework lets you chain Open WebUI tool calls with transformations, filters, and re-rankers in a typed pipeline
- —
Multi-source reasoning: agents can query Open WebUI, a vector store, and a SQL database in a single turn and synthesize results
- —
Observability integrations show exactly what Open WebUI tools were called, what data was returned, and how it influenced the final answer
Open WebUI in LlamaIndex
Open WebUI and 4,000+ other MCP servers. One platform. One governance layer.
Teams that connect Open WebUI to LlamaIndex through Vinkius don't need to source, host, or maintain individual MCP servers. Every tool call runs inside a hardened runtime with credential isolation, DLP, and a signed audit chain.
Raw MCP | Vinkius | |
|---|---|---|
| Server catalog | Find and host yourself | 4,000+ managed |
| Infrastructure | Self-hosted | Sandboxed V8 isolates |
| Credential handling | Plaintext in config | Vault + runtime injection |
| Data loss prevention | None | Configurable DLP policies |
| Kill switch | None | Global instant shutdown |
| Financial circuit breakers | None | Per-server limits + alerts |
| Audit trail | None | Ed25519 signed logs |
| SIEM log streaming | None | Splunk, Datadog, Webhook |
| Honeytokens | None | Canary alerts on leak |
| Custom domains | Not applicable | DNS challenge verified |
| GDPR compliance | Manual effort | Automated purge + export |
Why teams choose Vinkius for Open WebUI in LlamaIndex
The Open WebUI MCP Server runs on Vinkius-managed infrastructure inside AWS — a purpose-built runtime with per-request V8 isolates, Ed25519 signed audit chains, and sub-40ms cold starts. All 12 tools execute in hardened sandboxes optimized for native MCP execution.
Your AI agents in LlamaIndex only access the data you authorize, with DLP that blocks sensitive information from ever reaching the model, kill switch for instant shutdown, and up to 60% token savings. Enterprise-grade infrastructure, zero maintenance.

* Every MCP server runs on Vinkius-managed infrastructure inside AWS - a purpose-built runtime with per-request V8 isolates, Ed25519 signed audit chains, and sub-40ms cold starts optimized for native MCP execution. See our infrastructure
How Vinkius secures
Open WebUI for LlamaIndex
Every tool call from LlamaIndex to the Open WebUI MCP Server is protected by DLP redaction, cryptographic audit chains, V8 sandbox isolation, kill switch, and financial circuit breakers.
Frequently asked questions
How can I check if a model is available in my Open WebUI instance?
You can use the list_models tool. It will return a complete list of all configured models, including those from Ollama, OpenAI, and internal Open WebUI functions.
Can I add a website to my RAG collection using just a URL?
Yes! Use the process_web_url tool. Provide the URL and the target collection name, and the server will scrape and index the content for you.
How do I know when my uploaded file is ready for querying?
After using upload_file, you can check the ingestion progress by calling get_file_status with the returned File ID. It will tell you if the status is 'completed' or 'pending'.
How does LlamaIndex connect to MCP servers?
Use the MCP client adapter to create a connection. LlamaIndex discovers all tools and wraps them as query engine tools compatible with any LlamaIndex agent.
Can I combine MCP tools with vector stores?
Yes. LlamaIndex agents can query Open WebUI tools and vector store indexes in the same turn, combining real-time and embedded data for grounded responses.
Does LlamaIndex support async MCP calls?
Yes. LlamaIndex's async agent framework supports concurrent MCP tool calls for high-throughput data processing pipelines.
BasicMCPClient not found
Install: pip install llama-index-tools-mcp
Explore More MCP Servers
View all →
HiBob
11 toolsAutomate HR workflows via HiBob — manage employees, time off, and tasks directly from any AI agent.

Modash
11 toolsFind and analyze influencers across Instagram, TikTok, and YouTube with Modash.

Five9 QM
12 toolsManage agent evaluations, review recorded interactions, and track quality metrics via AI agents with Five9 QM.

FirstPromoter
12 toolsManage affiliates, track referrals, and handle rewards via AI agents with FirstPromoter.
