LocalAI Connector for AI agents.

19 live capabilities

Run private LLMs and generate images on your own hardware without cloud costs.

Live agent request LocalAI / Connector

Waiting for input…

AI Agent

Why people use LocalAI

LocalAI for Private Data Processing in Sensitive Industries

LocalAI changes that dynamic. It lets you keep your data inside your own walls while still using the same capabilities you already know. You can run a local model to summarize files or transcribe calls, then feed that info directly into your workflow. You get the power of an AI agent without the risk of a data leak.

What Vinkius changes

You get a private, self-hosted AI backend that connects to any standard client.

Use it from Claude, ChatGPT, Cursor or another AI client you already have.

One account · 5,900+ Connectors

Real-world use case 01

Private meeting transcription

A project manager needs to transcribe sensitive internal meetings.
Real-world use case 02

Building a private knowledge base

A researcher wants to index thousands of private documents.
Real-world use case 03

Cost-free image generation

A content creator needs to generate 500 product images.

Complete set · 19capabilities

The complete LocalAI capability set.

These are the exact actions your AI can choose when you ask it to work with LocalAI.

Capability set01 / 05

01—04

4 capabilities in this set.

Part of 19 available through LocalAI.

01 Capability
Open responses
Generate open-ended text responses for various prompts. It helps your agent provide more natural and less structured answers.
02 Capability
Chat completions
Generate chat completions using the standard OpenAI-compatible format. This is the primary way to talk to your local LLMs.
03 Capability
Face analyze
Extract demographic information from faces in photos. It provides structured data from visual inputs.
04 Capability
Get auth status
Check if your current authentication is valid and see active providers. This keeps your connection stable.

Capability set02 / 05

05—08

4 capabilities in this set.

Part of 19 available through LocalAI.

05 Capability
Rerank documents
Reorder search results to put the most relevant documents at the top. This makes your local search much more accurate.
06 Capability
Anthropic messages
Send messages using the Anthropic-compatible format for local models. This lets you use local weights with familiar request structures.
07 Capability
Apply model
Install a new model from the gallery onto your local instance. You can expand your capabilities without manual file moving.
08 Capability
Create embeddings
Turn text into vector embeddings for building local search systems. It's the first step for any local RAG project.

Capability set03 / 05

09—12

4 capabilities in this set.

Part of 19 available through LocalAI.

09 Capability
Detect objects
Identify and locate specific objects within an image file. This lets your agent see and describe the contents of your photos.
10 Capability
Face identify
Match a face against a database of known individuals. Use this for secure, local identity verification.
11 Capability
Face register
Add a new face to your local database for future identification. It's how you build your local facial recognition library.
12 Capability
Face verify
Confirm if a face matches a specific person in your database. This handles 1:1 verification on your own hardware.

Capability set04 / 05

13—16

4 capabilities in this set.

Part of 19 available through LocalAI.

13 Capability
Generate image
Create images from text prompts with support for negative prompts. It lets you build visual content without a cloud subscription.
14 Capability
Text to speech
Turn written text into natural-sounding audio files. It lets you generate voice content locally and privately.
15 Capability
Transcribe audio
Convert audio files into written text for easy searching. Use this to turn meetings or lectures into searchable text.
16 Capability
Get auth usage
View your personal token usage to monitor local resource consumption. It helps you track how much the local instance is working.

Capability set05 / 05

17—19

3 capabilities in this set.

Part of 19 available through LocalAI.

17 Capability
Get system info
Get a snapshot of your backend and system status. Use this to see if your hardware is keeping up with the load.
18 Capability
Get version
Check which version of LocalAI your instance is currently running. This is helpful for troubleshooting and updates.
19 Capability
List models
See all the models currently loaded and ready on your machine. It lets you know what you can actually call right now.

Set up in minutes

One URL. Then ask LocalAI to work.

Claude and ChatGPT only need the Connector URL. Copy it once, add it in settings, and use LocalAI from the conversation.

Choose your client

Live preview

Advanced clients IDE · CLI

Claude · Web + desktop

Official guide ↗

Connector URL · ready to paste

Streamable HTTP

https://edge.vinkius.com/vk_preview_rNQOAeEr0Jny5r5Ag0JD5dh4JLxiMfgFSBUDjX1k/mcp

Step 01

Open Connectors

In Claude Web or Claude Desktop, open Settings and choose Connectors.
Step 02

Add the URL

Choose Add custom connector, name it LocalAI, and paste the URL above.
Step 03

Turn it on in chat

Select +, open Connectors, and enable LocalAI for the conversation.

ChatGPT · Web + desktop

Official guide ↗

Connector URL · ready to paste

Streamable HTTP

https://edge.vinkius.com/vk_preview_rNQOAeEr0Jny5r5Ag0JD5dh4JLxiMfgFSBUDjX1k/mcp

Step 01

Open MCP settings

On desktop, open Settings and MCP servers. On web, open your workspace app or connector settings.
Step 02

Add the URL

Choose Add server with Streamable HTTP, or create a custom MCP app, then paste the LocalAI URL.
Step 03

Save and start

Save the connection and enable LocalAI in your conversation. Desktop may ask you to restart once.

Cursor · IDE configuration

Official guide ↗

Advanced setup

{
  "mcpServers": {
    "localai": {
      "url": "https://edge.vinkius.com/vk_preview_rNQOAeEr0Jny5r5Ag0JD5dh4JLxiMfgFSBUDjX1k/mcp"
    }
  }
}

Step 01

Open MCP Settings

Press Cmd+Shift+P (macOS) or Ctrl+Shift+P (Windows/Linux) → search "MCP Settings"
Step 02

Add the server config

Paste the JSON configuration above into the mcp.json file that opens
Step 03

Save the file

Cursor will automatically detect the new Connector
Step 04

Start using LocalAI

Open Agent mode in chat and ask: "Using LocalAI, help me...". 19 tools available

VS Code Copilot · IDE configuration

Official guide ↗

Advanced setup

{
  "mcpServers": {
    "localai": {
      "url": "https://edge.vinkius.com/vk_preview_rNQOAeEr0Jny5r5Ag0JD5dh4JLxiMfgFSBUDjX1k/mcp"
    }
  }
}

Step 01

Create MCP config

Create a .vscode/mcp.json file in your project root
Step 02

Add the server config

Paste the JSON configuration above
Step 03

Enable Agent mode

Open GitHub Copilot Chat and switch to Agent mode using the dropdown
Step 04

Start using LocalAI

Ask Copilot: "Using LocalAI, help me...". 19 tools available

Windsurf · IDE configuration

Official guide ↗

Advanced setup

{
  "mcpServers": {
    "localai": {
      "url": "https://edge.vinkius.com/vk_preview_rNQOAeEr0Jny5r5Ag0JD5dh4JLxiMfgFSBUDjX1k/mcp"
    }
  }
}

Step 01

Open MCP Settings

Go to Settings → MCP Configuration or press Cmd+Shift+P and search "MCP"
Step 02

Add the server

Paste the JSON configuration above into mcp_config.json
Step 03

Save and reload

Windsurf will detect the new server automatically
Step 04

Start using LocalAI

Open Cascade and ask: "Using LocalAI, help me...". 19 tools available

Cline · IDE configuration

Official guide ↗

Advanced setup

{
  "mcpServers": {
    "localai": {
      "url": "https://edge.vinkius.com/vk_preview_rNQOAeEr0Jny5r5Ag0JD5dh4JLxiMfgFSBUDjX1k/mcp"
    }
  }
}

Step 01

Open Cline MCP Settings

Click the Connectors icon in the Cline sidebar panel
Step 02

Add remote server

Click "Add Connector" and paste the configuration above
Step 03

Enable the server

Toggle the server switch to ON
Step 04

Start using LocalAI

Ask Cline: "Using LocalAI, help me...". 19 tools available

Claude Code · Terminal command

Official guide ↗

Advanced setup

claude mcp add localai --transport http "https://edge.vinkius.com/vk_preview_rNQOAeEr0Jny5r5Ag0JD5dh4JLxiMfgFSBUDjX1k/mcp"

Step 01

Install Claude Code

Run npm install -g @anthropic-ai/claude-code if not already installed
Step 02

Add the Connector

Run the command above in your terminal
Step 03

Verify the connection

Run claude mcp to list connected servers, or type /mcp inside a session
Step 04

Start using LocalAI

Ask Claude: "Using LocalAI, show me...". 19 tools are ready

Where the request belongs

Work LocalAI can move forward.

Built around the request

This is for the privacy-conscious developer who can't risk leaking data, the AI researcher testing open-weight models, and the DevOps engineer building internal capabilities.

01

Privacy-Conscious Developer

Processes sensitive customer data and builds local RAG systems without using cloud APIs.

02

AI Researcher

Tests and swaps different open-weight models for vision and audio tasks on their own hardware.

03

DevOps Engineer

Integrates local AI into internal pipelines to avoid recurring per-token costs and external dependencies.

Build the capability set

Each Connector adds new actions and data without changing how you work.

Browse Connectors

01 5 capabilities

Monster API (Serverless GPU & AI Model Hosting)

Access powerful AI models for image generation, text-to-speech, and transcription via serverless GPU infrastructure.

02 6 capabilities

Fireworks AI

Empower LLM applications via Fireworks AI. perform ultra-fast chat completions, generate embeddings and images, and transcribe audio directly from any AI agent.

03 27 capabilities

Together AI

Access 100+ open-source models for chat, image generation, and fine-tuning. Power your AI agents with Llama 3.3, Flux, and more.

04 4 capabilities

Hugging Face Audio

Connect Hugging Face Audio to any AI agent via MCP.

05 10 capabilities

Groq

Run large language models at unprecedented speed with custom LPU hardware that delivers real-time AI inference at massive scale.

06 4 capabilities

DeepInfra (Serverless LLM Inference)

Run top-tier LLMs, image generation, and embeddings via DeepInfra's serverless infrastructure directly from your AI agent.

Bring your own AI

Change the model, client or framework. Keep LocalAI connected.

Before you connect

Questions about LocalAI.

The practical details behind the request, access and result.

Does LocalAI MCP keep my data private?

Yes, it keeps your data private because the AI models run on your own hardware. No data is sent to a third-party cloud provider for processing.

Can I use LocalAI MCP with Claude or Cursor?

Yes, you can connect it to any MCP-compatible client like Claude, Cursor, or Windsurf to use your local models through those apps.

Do I need a powerful GPU to use LocalAI MCP?

Yes, running LLMs locally requires a machine with a capable GPU. Your hardware determines how fast the AI can generate text or images.

Is LocalAI MCP compatible with OpenAI APIs?

Yes, it provides an OpenAI-compatible API, which means most capabilities and apps that work with OpenAI can be pointed at your local instance instead.

How do I add new models to my LocalAI setup?

You can use the apply_model capability to install new models from the gallery directly onto your local instance without manual file management.

Can I generate images with LocalAI MCP?

Yes, you can use the generate_image capability to create visuals from text prompts using models like Stable Diffusion on your own hardware.

How can I see which AI models are currently installed on my LocalAI server?

You can use the list_models capability. It will return a complete list of all available models on your instance, including their IDs and capabilities.

Does this server support generating images locally?

Yes! By using the generate_image capability, you can provide a prompt and optional size to generate images directly on your hardware using supported models like Stable Diffusion.

Can I use this to transcribe audio files into text?

Absolutely. The transcribe_audio capability allows you to send audio data or file paths to your LocalAI instance for high-quality transcription using models like Whisper.

One connection away

Give your agent a direct line to LocalAI.

Connect LocalAI once. Keep it beside 5,900+ managed Connectors when the next task needs more.

Explore every Connector No credit card required · Free tier available