LocalAI MCP Server for Mastra AIGive Mastra AI instant access to 19 tools to Anthropic Messages, Apply Model, Chat Completions, and more
GDPR Free for SubscribersMastra AI is a TypeScript-native agent framework built for modern web stacks. Connect LocalAI through Vinkius and Mastra agents discover all tools automatically. type-safe, streaming-ready, and deployable anywhere Node.js runs.
Ask AI about this MCP Server for Mastra AI
The LocalAI MCP Server for Mastra AI is a standout in the Ai Frontier category — giving your AI agent 19 tools to work with, ready to go from day one.
Vinkius delivers Streamable HTTP and SSE to any MCP client
Geminiimport { Agent } from "@mastra/core/agent";
import { createMCPClient } from "@mastra/mcp";
import { openai } from "@ai-sdk/openai";
async function main() {
// Your Vinkius token. get it at cloud.vinkius.com
const mcpClient = await createMCPClient({
servers: {
"localai": {
url: "https://edge.vinkius.com/[YOUR_TOKEN_HERE]/mcp",
},
},
});
const tools = await mcpClient.getTools();
const agent = new Agent({
name: "LocalAI Agent",
instructions:
"You help users interact with LocalAI " +
"using 19 tools.",
model: openai("gpt-4o"),
tools,
});
const result = await agent.generate(
"What can I do with LocalAI?"
);
console.log(result.text);
}
main();
* Every MCP server runs on Vinkius-managed infrastructure inside AWS - a purpose-built runtime with per-request V8 isolates, Ed25519 signed audit chains, and sub-40ms cold starts optimized for native MCP execution. See our infrastructure
About LocalAI MCP Server
Connect your LocalAI instance to any AI agent and leverage powerful multimodal capabilities directly from your own infrastructure.
Mastra's agent abstraction provides a clean separation between LLM logic and LocalAI tool infrastructure. Connect 19 tools through Vinkius and use Mastra's built-in workflow engine to chain tool calls with conditional logic, retries, and parallel execution. deployable to any Node.js host in one command.
What you can do
- Text Generation — Use
chat_completionsoranthropic_messagesto generate text using local models with full OpenAI or Anthropic compatibility. - Image Synthesis — Create visual content from text prompts using the
generate_imagetool, supporting custom sizes and negative prompts. - Audio Processing — Convert speech to text with
transcribe_audioor generate natural-sounding speech from text usingtext_to_speech. - Advanced Search & RAG — Generate vector embeddings with
create_embeddingsand improve search relevance using thererank_documentstool. - Computer Vision — Analyze images and identify elements using the
detect_objectstool. - System Management — Monitor your instance with
list_models,get_system, andgetVersionto ensure optimal performance.
The LocalAI MCP Server exposes 19 tools through the Vinkius. Connect it to Mastra AI in under two minutes — credentials fully managed, no infrastructure to provision, no vendor lock-in. Your configuration, your data, your control.
All 19 LocalAI tools available for Mastra AI
When Mastra AI connects to LocalAI through Vinkius, your AI agent gets direct access to every tool listed below — spanning self-hosted, llm-inference, image-generation, and more. Every call runs in a secure, isolated environment with full audit visibility. Beyond a simple connection, you get real-time monitoring of agent activity, enterprise governance, and optimized token usage.
Anthropic messages on LocalAI
Generate messages (Anthropic compatible)
Apply model on LocalAI
Install a model from the gallery
Chat completions on LocalAI
Generate chat completions (OpenAI compatible)
Create embeddings on LocalAI
Create text embeddings
Detect objects on LocalAI
Detect objects in an image
Face analyze on LocalAI
Analyze face demographics
Face identify on LocalAI
Identify faces (1:N)
Face register on LocalAI
Enroll a face into the store
Face verify on LocalAI
Verify faces (1:1)
Generate image on LocalAI
Supports negative prompts using | separator. Generate images from text prompts
Get auth status on LocalAI
Check authentication state and providers
Get auth usage on LocalAI
View personal token usage
Get system info on LocalAI
View system and backend info
Get version on LocalAI
Get LocalAI version
List models on LocalAI
List available models
Open responses on LocalAI
Generate open responses
Rerank documents on LocalAI
Rerank documents based on a query
Text to speech on LocalAI
Convert text to audio (TTS)
Transcribe audio on LocalAI
Pass the file data or path as required by your LocalAI setup. Transcribe audio to text
Connect LocalAI to Mastra AI via MCP
Follow these steps to wire LocalAI into Mastra AI. The entire setup takes under two minutes — your credentials stay safe behind Vinkius.
Install dependencies
npm install @mastra/core @mastra/mcp @ai-sdk/openaiReplace the token
[YOUR_TOKEN_HERE] with your Vinkius tokenRun the agent
agent.ts and run with npx tsx agent.tsExplore tools
Why Use Mastra AI with the LocalAI MCP Server
Mastra AI provides unique advantages when paired with LocalAI through the Model Context Protocol.
Mastra's agent abstraction provides a clean separation between LLM logic and tool infrastructure. add LocalAI without touching business code
Built-in workflow engine chains MCP tool calls with conditional logic, retries, and parallel execution for complex automation
TypeScript-native: full type inference for every LocalAI tool response with IDE autocomplete and compile-time checks
One-command deployment to any Node.js host. Vercel, Railway, Fly.io, or your own infrastructure
LocalAI + Mastra AI Use Cases
Practical scenarios where Mastra AI combined with the LocalAI MCP Server delivers measurable value.
Automated workflows: build multi-step agents that query LocalAI, process results, and trigger downstream actions in a typed pipeline
SaaS integrations: embed LocalAI as a first-class tool in your product's AI features with Mastra's clean agent API
Background jobs: schedule Mastra agents to query LocalAI on a cron and store results in your database automatically
Multi-agent systems: create specialist agents that collaborate using LocalAI tools alongside other MCP servers
Example Prompts for LocalAI in Mastra AI
Ready-to-use prompts you can give your Mastra AI agent to start working with LocalAI immediately.
"List all models available on my LocalAI instance."
"Generate a chat response using the 'llama-3' model about the benefits of local AI."
"Create an image of a futuristic library using the 'stablediffusion' model."
Troubleshooting LocalAI MCP Server with Mastra AI
Common issues when connecting LocalAI to Mastra AI through Vinkius, and how to resolve them.
createMCPClient not exported
npm install @mastra/mcpLocalAI + Mastra AI FAQ
Common questions about integrating LocalAI MCP Server with Mastra AI.
How does Mastra AI connect to MCP servers?
MCPClient with the server URL and pass it to your agent. Mastra discovers all tools and makes them available with full TypeScript types.Can Mastra agents use tools from multiple servers?
Does Mastra support workflow orchestration?
Explore More MCP Servers
View all →
Toast
10 toolsManage restaurant orders, menus, employees, labor, tables, and payments for your Toast POS through natural conversation.
Google Firestore Collection
3 toolsThis MCP does exactly one thing: it manages documents in a single Google Firestore Collection. That's its only function, and nothing else. Incredible for giving your AI a secure NoSQL database.
Aircall
10 toolsCloud business phone system — manage calls, contacts, and team availability via AI.
Zenodo
14 toolsManage scientific research and datasets on Zenodo—create depositions, upload files, and search records directly from your AI agent.