Together AI Connector for AI agents.
7 live capabilities
Run open-source LLMs and fine-tune models with high-speed inference.
Waiting for input…
Why people use Together AI
Together AI for High-Speed Open-Source Model Inference
With this Connector, you can skip the infrastructure setup entirely. You just point your agent at the Together AI network and get results in milliseconds. It lets you focus on building your app instead of managing the underlying compute.
What Vinkius changes
You get high-speed inference for open-source models without needing to manage any GPU infrastructure.
Use it from Claude, ChatGPT, Cursor or another AI client you already have.
One account · 5,900+ Connectors
- Real-world use case 01
Comparing model performance
A developer asks their agent to run the same prompt through Llama 3 and Mixtral to see which model handles complex reasoning better.
- Real-world use case 02
Building a RAG system
An engineer asks the agent to turn 50 product descriptions into embeddings for a vector store using the generate_embeddings capability.
- Real-world use case 03
Training a niche model
An ML specialist uses create_finetune_job to train a model on internal company documents for a private knowledge base.
Complete set · 7capabilities
The complete Together AI capability set.
These are the exact actions your AI can choose when you ask it to work with Together AI.
01—04
4 capabilities in this set.
Part of 7 available through Together AI.
- 01 Capability
Chat completion
Get a conversational response from a model like Mixtral or Llama. It handles multi-turn chat logic easily.
- 02 Capability
Text completion
Generate a direct text response based on a single prompt. This is useful for simple completion tasks.
- 03 Capability
Create finetune job
Start a new training run using a specific base model and dataset. It automates the provisioning of training resources.
- 04 Capability
Generate embeddings
Turn a list of text strings into vector embeddings for your database. This is perfect for building search capabilities.
05—07
3 capabilities in this set.
Part of 7 available through Together AI.
- 05 Capability
Generate image
Create an image from a text prompt using diffusion models. It lets your agent create visual content on the fly.
- 06 Capability
List finetune jobs
See all your active and finished fine-tuning jobs. This helps you keep track of your training history.
- 07 Capability
List available models
See every model currently hosted on the Together AI network. Use this to find the right engine for your task.
Set up in minutes
One URL. Then ask Together AI to work.
Claude and ChatGPT only need the Connector URL. Copy it once, add it in settings, and use Together AI from the conversation.
Choose your client
Live previewAdvanced clients IDE · CLI
Claude · Web + desktop
Connector URL · ready to paste
Streamable HTTPhttps://edge.vinkius.com/vk_preview_uwxFbBTrWtpKdtNP0Ee38Zmxxir6fie6FBKXtn0o/mcp - Step 01
Open Connectors
In Claude Web or Claude Desktop, open Settings and choose Connectors.
- Step 02
Add the URL
Choose Add custom connector, name it Together AI, and paste the URL above.
- Step 03
Turn it on in chat
Select +, open Connectors, and enable Together AI for the conversation.
ChatGPT · Web + desktop
Connector URL · ready to paste
Streamable HTTPhttps://edge.vinkius.com/vk_preview_uwxFbBTrWtpKdtNP0Ee38Zmxxir6fie6FBKXtn0o/mcp - Step 01
Open MCP settings
On desktop, open Settings and MCP servers. On web, open your workspace app or connector settings.
- Step 02
Add the URL
Choose Add server with Streamable HTTP, or create a custom MCP app, then paste the Together AI URL.
- Step 03
Save and start
Save the connection and enable Together AI in your conversation. Desktop may ask you to restart once.
Cursor · IDE configuration
Advanced setup
{
"mcpServers": {
"together-ai": {
"url": "https://edge.vinkius.com/vk_preview_uwxFbBTrWtpKdtNP0Ee38Zmxxir6fie6FBKXtn0o/mcp"
}
}
}- Step 01
Open MCP Settings
Press Cmd+Shift+P (macOS) or Ctrl+Shift+P (Windows/Linux) → search "MCP Settings"
- Step 02
Add the server config
Paste the JSON configuration above into the mcp.json file that opens
- Step 03
Save the file
Cursor will automatically detect the new Connector
- Step 04
Start using Together AI
Open Agent mode in chat and ask: "Using Together AI, help me...". 7 tools available
VS Code Copilot · IDE configuration
Advanced setup
{
"mcpServers": {
"together-ai": {
"url": "https://edge.vinkius.com/vk_preview_uwxFbBTrWtpKdtNP0Ee38Zmxxir6fie6FBKXtn0o/mcp"
}
}
}- Step 01
Create MCP config
Create a .vscode/mcp.json file in your project root
- Step 02
Add the server config
Paste the JSON configuration above
- Step 03
Enable Agent mode
Open GitHub Copilot Chat and switch to Agent mode using the dropdown
- Step 04
Start using Together AI
Ask Copilot: "Using Together AI, help me...". 7 tools available
Windsurf · IDE configuration
Advanced setup
{
"mcpServers": {
"together-ai": {
"url": "https://edge.vinkius.com/vk_preview_uwxFbBTrWtpKdtNP0Ee38Zmxxir6fie6FBKXtn0o/mcp"
}
}
}- Step 01
Open MCP Settings
Go to Settings → MCP Configuration or press Cmd+Shift+P and search "MCP"
- Step 02
Add the server
Paste the JSON configuration above into mcp_config.json
- Step 03
Save and reload
Windsurf will detect the new server automatically
- Step 04
Start using Together AI
Open Cascade and ask: "Using Together AI, help me...". 7 tools available
Cline · IDE configuration
Advanced setup
{
"mcpServers": {
"together-ai": {
"url": "https://edge.vinkius.com/vk_preview_uwxFbBTrWtpKdtNP0Ee38Zmxxir6fie6FBKXtn0o/mcp"
}
}
}- Step 01
Open Cline MCP Settings
Click the Connectors icon in the Cline sidebar panel
- Step 02
Add remote server
Click "Add Connector" and paste the configuration above
- Step 03
Enable the server
Toggle the server switch to ON
- Step 04
Start using Together AI
Ask Cline: "Using Together AI, help me...". 7 tools available
Claude Code · Terminal command
Advanced setup
claude mcp add together-ai --transport http "https://edge.vinkius.com/vk_preview_uwxFbBTrWtpKdtNP0Ee38Zmxxir6fie6FBKXtn0o/mcp"- Step 01
Install Claude Code
Run npm install -g @anthropic-ai/claude-code if not already installed
- Step 02
Add the Connector
Run the command above in your terminal
- Step 03
Verify the connection
Run claude mcp to list connected servers, or type /mcp inside a session
- Step 04
Start using Together AI
Ask Claude: "Using Together AI, show me...". 7 tools are ready
Where the request belongs
Work Together AI can move forward.
This is for the AI engineer who needs to move fast without managing GPU clusters. It is for the developer who wants to test open-source models against proprietary ones or the ML specialist building custom embeddings at scale.
AI Developer
Testing different model outputs for a production app to see which handles nuance best.
Software Engineer
Integrating Llama 3 into a new feature via a chat interface to avoid writing boilerplate API calls.
ML Engineer
Batch processing logs into vectors for a new search capability using embedding models.
When one Connector is not enough
Carry the request into a workflow.
Combine Together AI with the systems that finish the task.
View all recipesBuild the capability set
Add more capabilities.
Each Connector adds new actions and data without changing how you work.
Browse ConnectorsGradient AI (LLM API & Finetuning)
Access powerful LLMs, fine-tune models on your own data, and generate embeddings directly through your AI agent.
DeepInfra (Serverless LLM Inference)
Run top-tier LLMs, image generation, and embeddings via DeepInfra's serverless infrastructure directly from your AI agent.
Predibase (LLM Serving & Finetuning)
Deploy and query fine-tuned LLMs via Predibase. run inference, classify text, and monitor deployment metrics directly from your AI agent.
NVIDIA AI
Access LLMs, embeddings, code generation, and reasoning via NVIDIA API Catalog.
Mistral AI (Frontier LLMs & Embeddings)
Manage AI inference via Mistral. execute chat completions, generate RAG embeddings, and audit frontier models.
Eden AI
Access 100+ AI models through a single API. route LLMs, generate embeddings, and execute specialized AI tasks like OCR and translation.
Bring your own AI
Change the model, client or framework. Keep Together AI connected.
-
Claude -
ChatGPT -
Gemini -
Cursor -
VS Code -
Windsurf -
ZCode -
Cline -
Zed -
Continue -
Kiro -
Roo Code -
Zencoder -
Goose -
Void -
Augment Code -
Amp -
Qodo -
Tabnine -
Pieces -
Sourcegraph Cody -
JetBrains -
Warp -
Amazon Q -
Antigravity -
BoltAI -
Raycast -
Jan -
LM Studio -
AnythingLLM -
Open WebUI -
Msty -
Cherry Studio -
LibreChat -
TypingMind -
Chorus -
5ire -
n8n -
LangChain -
LlamaIndex -
CrewAI -
Vercel AI SDK
Before you connect
Questions about Together AI.
The practical details behind the request, access and result.
How do I run Llama 3 models with the Together AI MCP?
You can run Llama 3 by simply asking your agent to perform a chat or text completion task. The Connector handles the connection to the high-speed inference hardware for you.
Can I use Together AI to generate images?
Yes, the Connector includes a capability to generate images from text descriptions. You just need to provide a descriptive prompt to your agent.
How do I create custom embeddings for my database?
You can ask your agent to generate embeddings for a list of strings. It will return the vector data you need to populate your search or recommendation database.
Can I fine-tune models using the Together AI MCP?
Yes, you can start new fine-tuning jobs by providing a base model and a dataset file through your chat interface. You can also check the status of these jobs.
Is Together AI good for high-speed inference?
Together AI is known for its high-speed inference, providing sub-second responses for models like Llama and Mixtral.
How do I see what models are available on Together AI?
You can ask your agent to list the available models. It will fetch the current list of open-source models hosted on the network.
Where do I obtain my Together AI API Key?
Log in to the developer portal via api.together.xyz/settings/api-keys. If you do not have an existing key, click Create API Key. This token enables the execution of remote inferences spanning their hosted clusters securely.
Do I have to pay to use Together models through the agent?
Yes. This connector simply routes your instructions to Together AI. Any tokens consumed during chat completion, embeddings, images generation, or fine-tuning workloads are billed directly to your registered Together AI account balance according to their official compute pricing models.
Can I access free models on Together AI?
Yes! Together AI frequently offers free tiers for certain open-source models intended for experimentation and research. You can query these directly from your agent without depleting your account balance, though specific free-tier rate limits will apply.
One connection away
Give your agent a direct line to Together AI.
Connect Together AI once. Keep it beside 5,900+ managed Connectors when the next task needs more.
Explore every Connector No credit card required · Free tier available