Can I check the budget and rate limits for a specific proxy key?

Yes. Use the `get_key_info` tool with the specific Key ID. Your agent will retrieve the exact rate limits, budget constraints, and current RPM usage associated with that token.

How do I see the model fallback paths configured in my proxy?

The `get_model_info` tool allows your agent to extract the global model directory. You'll see the exact fallback chains (e.g., if OpenAI fails, use Anthropic) and the physical endpoints assigned to each model name.

Can my agent create a new team to track specific division costs?

Absolutely. Use the `create_team` tool and provide a JSON payload defining the team name and optional budget limits. Your agent will provision the new team identity in LiteLLM, allowing for precise organizational cost tracking.

LiteLLM (LLM Proxy & Spend Tracking) MCP Server

Name: LiteLLM (LLM Proxy & Spend Tracking)
Availability: InStock
Author: Vinkius

litellm.ai

Built by Vinkius GDPR ToolsGrátis

Manage your LLM gateway via LiteLLM — generate API keys, track spending, and orchestrate model fallback paths.

Vinkius AI Gateway suporta streamable HTTP e SSE.

Funciona com todos os agentes de IA que você já usa

…e qualquer cliente compatível com MCP

LiteLLM MCP Server: veja o seu AI Agent em ação

AI Agent→Vinkius→LiteLLM (LLM Proxy & Spend Tracking)

You

Vinkius AI Gateway

GDPR·High Security·Kill Switch·Ultra-Low Latency·Plug and Play

Capacidades integradas (10)

create_model

Inject completely fresh routing endpoints (ex: new Bedrock Llama 4 endpoints)

create_team

Generate pristine organizational isolation tracking exact cost limits per division

create_user

Insert specific End-User identities bridging Vinkius with Proxy logs

delete_key

Delete an existing LLM proxy key entirely

delete_model

Delete explicitly routed LLM deployments preventing 500s dynamically

generate_key

Generate a new proxy API key isolating distinct microservices or teams

get_key_info

Get configuration and budget bounds for a specific LiteLLM API Key

get_model_info

Get array endpoints tracing exact Fallback paths like OpenAI -> Anthropic

get_team_info

Get internal logic bounds matching multiple routing users via Team UUID

get_user_info

Return precise End-User abstractions tracking total USD consumed natively

O que esse conector desbloqueia

Connect your LiteLLM Proxy instance to any AI agent and take full control of your LLM infrastructure, load balancing, and spend management through natural conversation.

What you can do

Key Orchestration — Generate and manage proxy API keys to isolate distinct microservices or teams, including precise budget and rate limit constraints directly from your agent
Model Routing Intelligence — Get detailed info on fallback paths (e.g., OpenAI -> Anthropic -> Groq) and verify exact routing endpoints assigned to your models
Real-time Spend Audit — Track total USD consumed by specific end-users or teams and monitor budget ceilings to ensure cost-effective AI deployments
Dynamic Model Control — Inject fresh routing endpoints (e.g., new AWS Bedrock or Azure OpenAI deployments) into your proxy runtime with zero downtime
Team & Organizational Isolation — Create and manage team profiles to track exact cost limits and operational boundaries per organizational division
Infrastructure Security — Instantly vaporize malicious or leaked keys and remove broken LLM deployments to prevent downstream 500 errors dynamically

How it works

1. Subscribe to this server
2. Enter your LiteLLM API URL and Master Key
3. Start managing your LLM gateway from Claude, Cursor, or any MCP-compatible client

Who is this for?

Platform Engineers — manage global LLM gateway configurations and audit model fallback paths through natural conversation
AI Ops Teams — monitor real-time AI spending and adjust team budgets across multiple LLM providers
Backend Developers — generate sub-keys for new microservices and verify model routing availability without leaving your IDE

Perguntas frequentes

Dê aos seus agentes de IA o poder do LiteLLM

Acesse o LiteLLM e mais de 2.000 servidores MCP — prontos para seus agentes usarem, agora mesmo. Sem código cola. Sem integrações customizadas. Apenas plugue o Vinkius AI Gateway e deixe seus agentes trabalharem.

DETALHES

CategoriaAi Frontier

Bland AI

10 ferramentas

Automate phone calls via Bland AI — dispatch voice agents, analyze call transcripts, and manage inbound phone numbers directly from your AI agent.

H2O.ai

6 ferramentas

Manage AI models via H2O.ai — track data frames, monitor machine learning models and training jobs, and audit cloud cluster status directly from any AI agent.

Together AI

7 ferramentas

Generate code, evaluate embeddings, and deploy open-source LLMs instantly from your local agent via Together AI's infrastructure.

Odoo eCommerce

6 ferramentas

List shop products, manage eCommerce orders, browse categories and customers — Odoo Website & eCommerce through natural conversation.

NOAA Aviation — Airport Weather Intelligence

5 ferramentas

Aviation weather data worldwide: METARs (current airport conditions), TAFs (24-hour airport forecasts), PIREPs (pilot reports of turbulence and icing), and SIGMETs/AIRMETs (significant aviation hazards) from the Aviation Weather Center.

AlgoDocs

10 ferramentas

AI document extraction orchestration — parse PDFs, images, and Word docs via AI.