Skip to content
Vinkius

Ollama Connector for AI agents.

12 live capabilities

Run local LLMs and generate vector embeddings for your private data.

Live agent request Ollama / Connector

Waiting for input…

AI Agent

Why people use Ollama

Ollama for Local LLM Inference and Privacy

This Connector puts your local models directly into your agent's hands. You just point your client at your Ollama setup and start talking to your own weights. You get the speed of local execution with the ease of a chat interface that feels like a natural extension of your current setup.

  • Claude
  • ChatGPT
  • Gemini
  • Cursor
  • Visual Studio Code
  • Windsurf

What Vinkius changes

You get a direct line to your local model library without any extra coding.

Use it from Claude, ChatGPT, Cursor or another AI client you already have.

One account · 6,100+ Connectors

  1. Real-world use case 01

    Building a private RAG

    You need to index internal docs.

  2. Real-world use case 02

    Testing local weights

    You want to see if Qwen handles your specific task better than Llama.

  3. Real-world use case 03

    Vision-based analysis

    You need to describe images in a batch.

Complete set · 12capabilities

The complete Ollama capability set.

These are the exact actions your AI can choose when you ask it to work with Ollama.

Capability set01 / 03

01—04

4 capabilities in this set.

Part of 12 available through Ollama.

  1. 01 Capability

    Openai chat completions

    Generate chat completions using an OpenAI-compatible endpoint. It supports vision and capability calling.

  2. 02 Capability

    Openai completions

    Use the OpenAI-compatible completion endpoint for your existing workflows. It supports various stop sequences.

  3. 03 Capability

    Openai embeddings

    Generate embeddings via an OpenAI-compatible endpoint. It's a drop-in replacement for standard embedding calls.

  4. 04 Capability

    Openai list models

    Get model IDs and ownership info using the OpenAI-compatible list endpoint. This is great for existing SDK users.

Capability set02 / 03

05—08

4 capabilities in this set.

Part of 12 available through Ollama.

  1. 05 Capability

    Openai responses

    Use the OpenAI-compatible Responses API to generate full responses. It works with your existing OpenAI-style logic.

  2. 06 Capability

    List models

    Get a full list of all models you have downloaded. Use this to see what's ready to run.

  3. 07 Capability

    List running models

    See which models are currently loaded in your VRAM. It shows the model size and when they'll be unloaded.

  4. 08 Capability

    Chat

    Send multimodal messages and get structured JSON responses from your models. It handles images and capability calling in one go.

Capability set03 / 03

09—12

4 capabilities in this set.

Part of 12 available through Ollama.

  1. 09 Capability

    Generate embeddings

    Generate vector embeddings from single or multiple text inputs. This is perfect for building your own RAG pipelines.

  2. 10 Capability

    Generate

    Generate text completions with full control over parameters like seed and temperature. It supports structured JSON outputs too.

  3. 11 Capability

    Get version

    Retrieve the version of your local environment. Use this to ensure compatibility with your current capabilities.

  4. 12 Capability

    Show model details

    Get the deep specs for a specific model. You can check parameters, quantization, and tokenizer settings here.

Set up in minutes

One URL. Then ask Ollama to work.

Claude and ChatGPT only need the Connector URL. Copy it once, add it in settings, and use Ollama from the conversation.

Choose your client

Live preview
Advanced clients IDE · CLI

Claude · Web + desktop

Official guide ↗

Connector URL · ready to paste

Streamable HTTP
https://edge.vinkius.com/vk_preview_hYpu67YLXAzJ2w17TRhdjXKZcyynLB0AY9L4fYBJ/mcp
  1. Step 01

    Open Connectors

    In Claude Web or Claude Desktop, open Settings and choose Connectors.

  2. Step 02

    Add the URL

    Choose Add custom connector, name it Ollama, and paste the URL above.

  3. Step 03

    Turn it on in chat

    Select +, open Connectors, and enable Ollama for the conversation.

Where the request belongs

Work Ollama can move forward.

Built around the request

This is for the developer who needs to keep data local, the AI engineer testing specific weights, or the data scientist building a custom RAG pipeline.

01

AI Engineer

Testing model outputs and comparing performance across different local weights on a Tuesday afternoon.

02

Data Scientist

Generating embeddings for high-volume vector databases for a new search feature.

03

Privacy-Focused Developer

Running sensitive tasks on-premise to ensure no data ever leaves the local machine.

Bring your own AI

Change the model, client or framework. Keep Ollama connected.

  • Claude
  • ChatGPT
  • Gemini
  • Cursor
  • VS Code
  • Windsurf
  • ZCode
  • Cline
  • Zed
  • Continue
  • Kiro
  • Roo Code
  • Zencoder
  • Goose
  • Void
  • Augment Code
  • Amp
  • Qodo
  • Tabnine
  • Pieces
  • Sourcegraph Cody
  • JetBrains
  • Warp
  • Amazon Q
  • Antigravity
  • BoltAI
  • Raycast
  • Jan
  • LM Studio
  • AnythingLLM
  • Open WebUI
  • Msty
  • Cherry Studio
  • LibreChat
  • TypingMind
  • Chorus
  • 5ire
  • n8n
  • LangChain
  • LlamaIndex
  • CrewAI
  • Vercel AI SDK

Before you connect

Questions about Ollama.

The practical details behind the request, access and result.

How do I get my Ollama API key?

Visit the Ollama API keys page to create or manage your API key. Once created, copy it and paste it into the API key field in the setup wizard. The key is used as a Bearer token in the Authorization header for all requests to https://ollama.com/api. API keys don't currently expire, but you can revoke them at any time.

Which models are available through this Connector?

All models available on ollama.com are accessible, including Gemma, GPT-OSS, Qwen, Llama, and many others. Use list_models to see all available models, and show_model_details to inspect a model's capabilities (completion, vision, capabilities), parameter size, quantization level, and architecture details.

Can my AI use vision models to analyze images?

Yes! The generate and chat capabilities support image inputs as base64-encoded strings. Use a vision-capable model (check with show_model_details. look for 'vision' in capabilities) and pass images in the request. The OpenAI-compatible openai_chat_completions capability also supports image_url content parts for vision models.

What is the difference between native and OpenAI-compatible endpoints?

The native Ollama endpoints (generate, chat, embed) offer the full feature set including thinking mode, keep_alive control, and detailed response metadata (token counts, durations). The OpenAI-compatible endpoints (/v1/chat/completions, /v1/completions, /v1/embeddings, /v1/responses) provide drop-in compatibility for existing applications built with the OpenAI SDK. they use the same request/response format as OpenAI's API.

Does this Connector support capability calling (function calling)?

Yes. The chat capability supports capability calling. pass a JSON array of capability definitions in the tools_json parameter. The model will return capability calls in the response when it determines a function should be invoked. The OpenAI-compatible openai_chat_completions capability also supports capabilities via the tools_json parameter.

Can I generate structured JSON output?

Yes. Both generate and chat capabilities support structured outputs via the format_json parameter. You can pass the string 'json' for basic JSON mode, or a full JSON schema object to enforce a specific output structure. The OpenAI-compatible endpoints also support response_format for structured output.

What is the base URL for API calls?

All API calls are sent to https://ollama.com/api with the Authorization: Bearer YOUR_API_KEY header. The engine automatically appends the correct path for each endpoint (e.g. /generate, /chat, /v1/chat/completions). This Connector targets the Ollama cloud API. for local Ollama instances, the base URL would be http://localhost:11434/api (no API key required).

Which models are available through this MCP?

All models available on ollama.com are accessible, including Gemma, GPT-OSS, Qwen, Llama, and many others. Use list_models to see all available models, and show_model_details to inspect a model's capabilities (completion, vision, capabilities), parameter size, quantization level, and architecture details.

Does this MCP support capability calling (function calling)?

Yes. The chat capability supports capability calling. pass a JSON array of capability definitions in the tools_json parameter. The model will return capability calls in the response when it determines a function should be invoked. The OpenAI-compatible openai_chat_completions capability also supports capabilities via the tools_json parameter.

One connection away

Give your agent a direct line to Ollama.

Connect Ollama once. Keep it beside 6,100+ managed Connectors when the next task needs more.

Explore every Connector No credit card required · Free tier available