LibreChat MCP Server for LlamaIndexGive LlamaIndex instant access to 4 tools to Chat Completions, List Models, Login, and more
LlamaIndex specializes in data-aware AI agents that connect LLMs to structured and unstructured sources. Add LibreChat as an MCP tool provider through Vinkius and your agents can query, analyze, and act on live data alongside your existing indexes.
Ask AI about this MCP Server for LlamaIndex
The LibreChat MCP Server for LlamaIndex is a standout in the Productivity category — giving your AI agent 4 tools to work with, ready to go from day one.
Vinkius delivers Streamable HTTP and SSE to any MCP client
import asyncio
from llama_index.tools.mcp import BasicMCPClient, McpToolSpec
from llama_index.core.agent.workflow import FunctionAgent
from llama_index.llms.openai import OpenAI
async def main():
# Your Vinkius token. get it at cloud.vinkius.com
mcp_client = BasicMCPClient("https://edge.vinkius.com/[YOUR_TOKEN_HERE]/mcp")
mcp_tool_spec = McpToolSpec(client=mcp_client)
tools = await mcp_tool_spec.to_tool_list_async()
agent = FunctionAgent(
tools=tools,
llm=OpenAI(model="gpt-4o"),
system_prompt=(
"You are an assistant with access to LibreChat. "
"You have 4 tools available."
),
)
response = await agent.run(
"What tools are available in LibreChat?"
)
print(response)
asyncio.run(main())
* Every MCP server runs on Vinkius-managed infrastructure inside AWS - a purpose-built runtime with per-request V8 isolates, Ed25519 signed audit chains, and sub-40ms cold starts optimized for native MCP execution. See our infrastructure
About LibreChat MCP Server
Connect your LibreChat instance to any AI agent and gain programmatic control over your self-hosted AI ecosystem. This server allows you to bridge your custom agents and models with any MCP-compatible client.
LlamaIndex agents combine LibreChat tool responses with indexed documents for comprehensive, grounded answers. Connect 4 tools through Vinkius and query live data alongside vector stores and SQL databases in a single turn. ideal for hybrid search, data enrichment, and analytical workflows.
What you can do
- Agent Orchestration — List all available agents and models configured in your LibreChat environment.
- Unified Completions — Create chat completions using the Agents API, providing an OpenAI-compatible interface for your custom setups.
- Open Responses — Utilize the Open Responses API specification to generate structured AI outputs.
- Session Management — Authenticate directly via email and password to retrieve access tokens when a static API key is not preferred.
The LibreChat MCP Server exposes 4 tools through the Vinkius. Connect it to LlamaIndex in under two minutes — credentials fully managed, no infrastructure to provision, no vendor lock-in. Your configuration, your data, your control.
All 4 LibreChat tools available for LlamaIndex
When LlamaIndex connects to LibreChat through Vinkius, your AI agent gets direct access to every tool listed below — spanning llm-orchestration, chat-interface, self-hosted, and more. Every call runs in a secure, isolated environment with full audit visibility. Beyond a simple connection, you get real-time monitoring of agent activity, enterprise governance, and optimized token usage.
Chat completions on LibreChat
Model corresponds to an Agent ID. Create a chat completion using the Agents API
List models on LibreChat
List available LibreChat models/agents
Login on LibreChat
Login to LibreChat to get access and refresh tokens
Open responses on LibreChat
Create a response using the Open Responses API
Connect LibreChat to LlamaIndex via MCP
Follow these steps to wire LibreChat into LlamaIndex. The entire setup takes under two minutes — your credentials stay safe behind Vinkius.
Install dependencies
pip install llama-index-tools-mcp llama-index-llms-openaiReplace the token
[YOUR_TOKEN_HERE] with your Vinkius tokenRun the agent
agent.py and run: python agent.pyExplore tools
Why Use LlamaIndex with the LibreChat MCP Server
LlamaIndex provides unique advantages when paired with LibreChat through the Model Context Protocol.
Data-first architecture: LlamaIndex agents combine LibreChat tool responses with indexed documents for comprehensive, grounded answers
Query pipeline framework lets you chain LibreChat tool calls with transformations, filters, and re-rankers in a typed pipeline
Multi-source reasoning: agents can query LibreChat, a vector store, and a SQL database in a single turn and synthesize results
Observability integrations show exactly what LibreChat tools were called, what data was returned, and how it influenced the final answer
LibreChat + LlamaIndex Use Cases
Practical scenarios where LlamaIndex combined with the LibreChat MCP Server delivers measurable value.
Hybrid search: combine LibreChat real-time data with embedded document indexes for answers that are both current and comprehensive
Data enrichment: query LibreChat to augment indexed data with live information before generating user-facing responses
Knowledge base agents: build agents that maintain and update knowledge bases by periodically querying LibreChat for fresh data
Analytical workflows: chain LibreChat queries with LlamaIndex's data connectors to build multi-source analytical reports
Example Prompts for LibreChat in LlamaIndex
Ready-to-use prompts you can give your LlamaIndex agent to start working with LibreChat immediately.
"List all available agents in my LibreChat instance."
"Login to LibreChat using my credentials."
"Ask agent_123 to summarize the latest trends in AI."
Troubleshooting LibreChat MCP Server with LlamaIndex
Common issues when connecting LibreChat to LlamaIndex through Vinkius, and how to resolve them.
BasicMCPClient not found
pip install llama-index-tools-mcpLibreChat + LlamaIndex FAQ
Common questions about integrating LibreChat MCP Server with LlamaIndex.
How does LlamaIndex connect to MCP servers?
Can I combine MCP tools with vector stores?
Does LlamaIndex support async MCP calls?
Explore More MCP Servers
View all →
Tactiq
10 toolsManage meeting transcripts via Tactiq u2014 access summaries, action items, speaker analytics, and search across all recordings from your AI agent.

Datanyze
10 toolsEquip your AI agent to retrieve B2B lead intelligence, technographics, and company insights via the Datanyze API.

Basecamp
7 toolsManage your Basecamp projects via AI — list tasks, read message boards, track campfire logs, and orchestrate to-dos seamlessly.

LangSmith
3 toolsObservability and evaluation platform for LLM applications — monitor traces, debug agent runs, and track performance metrics across your AI stack.
