Bring Llm
to Pydantic AI

Connect your Together AI account to any AI agent and integrate bleeding-edge open-source models seamlessly into your workflow. Harness world-class inference speeds to query Llama, Mixtral, and more, or orchestrate specialized model fine-tuning jobs straight from your chat environment.

What you can do

• Model Discovery — Explore and list all currently supported models on the Together network, identifying the best engine for any NLP or vision task
• Conversational AI — Run chat completion cycles on advanced models simply by supplying a model ID directly from the chat prompt
• Vector Storage Preparation — Generate instant rich embeddings for input texts, ready to populate your analytical databases
• Creative Media — Instruct external diffusion models to generate images using detailed physical descriptions
• Custom Fine-Tuning — Provision custom training runs by indicating a base framework and dataset file, alongside tracking existing job statuses

How it works

1. Sign up for this integration
2. Open your api.together.xyz control panel and fetch a developer API Key
3. Plug the key above, specify models to your agent, and enjoy sub-second serverless inference directly inside your command interface

Who is this for?

• AI Developers — Orchestrate fine-tuning parameters and launch jobs to the compute cluster without CLI switching
• Software Engineers — Use the provider to test completions using alternative open-source solutions (e.g., Llama 3) natively in code editors
• Machine Learning Engineers — Bulk-generate vectors from raw logs using embedding models attached straight to their main conversational agent