Can I check the budget and rate limits for a specific proxy key?

Yes. Use the `get_key_info` tool with the specific Key ID. Your agent will retrieve the exact rate limits, budget constraints, and current RPM usage associated with that token.

How do I see the model fallback paths configured in my proxy?

The `get_model_info` tool allows your agent to extract the global model directory. You'll see the exact fallback chains (e.g., if OpenAI fails, use Anthropic) and the physical endpoints assigned to each model name.

Can my agent create a new team to track specific division costs?

Absolutely. Use the `create_team` tool and provide a JSON payload defining the team name and optional budget limits. Your agent will provision the new team identity in LiteLLM, allowing for precise organizational cost tracking.

LiteLLM (LLM Proxy & Spend Tracking) MCP Server

Name: LiteLLM (LLM Proxy & Spend Tracking)
Availability: InStock
Author: Vinkius

litellm.ai

Built by Vinkius GDPR ToolsFree

Manage your LLM gateway via LiteLLM — generate API keys, track spending, and orchestrate model fallback paths.

Vinkius AI Gateway supports streamable HTTP and SSE.

Works with every AI agent you already use

…and any MCP-compatible client

LiteLLM MCP Server: see your AI Agent in action

AI Agent→Vinkius→LiteLLM (LLM Proxy & Spend Tracking)

You

Vinkius AI Gateway

GDPR·High Security·Kill Switch·Ultra-Low Latency·Plug and Play

Built-in capabilities (10)

create_model

Inject completely fresh routing endpoints (ex: new Bedrock Llama 4 endpoints)

create_team

Generate pristine organizational isolation tracking exact cost limits per division

create_user

Insert specific End-User identities bridging Vinkius with Proxy logs

delete_key

Delete an existing LLM proxy key entirely

delete_model

Delete explicitly routed LLM deployments preventing 500s dynamically

generate_key

Generate a new proxy API key isolating distinct microservices or teams

get_key_info

Get configuration and budget bounds for a specific LiteLLM API Key

get_model_info

Get array endpoints tracing exact Fallback paths like OpenAI -> Anthropic

get_team_info

Get internal logic bounds matching multiple routing users via Team UUID

get_user_info

Return precise End-User abstractions tracking total USD consumed natively

What this connector unlocks

Connect your LiteLLM Proxy instance to any AI agent and take full control of your LLM infrastructure, load balancing, and spend management through natural conversation.

What you can do

Key Orchestration — Generate and manage proxy API keys to isolate distinct microservices or teams, including precise budget and rate limit constraints directly from your agent
Model Routing Intelligence — Get detailed info on fallback paths (e.g., OpenAI -> Anthropic -> Groq) and verify exact routing endpoints assigned to your models
Real-time Spend Audit — Track total USD consumed by specific end-users or teams and monitor budget ceilings to ensure cost-effective AI deployments
Dynamic Model Control — Inject fresh routing endpoints (e.g., new AWS Bedrock or Azure OpenAI deployments) into your proxy runtime with zero downtime
Team & Organizational Isolation — Create and manage team profiles to track exact cost limits and operational boundaries per organizational division
Infrastructure Security — Instantly vaporize malicious or leaked keys and remove broken LLM deployments to prevent downstream 500 errors dynamically

How it works

1. Subscribe to this server
2. Enter your LiteLLM API URL and Master Key
3. Start managing your LLM gateway from Claude, Cursor, or any MCP-compatible client

Who is this for?

Platform Engineers — manage global LLM gateway configurations and audit model fallback paths through natural conversation
AI Ops Teams — monitor real-time AI spending and adjust team budgets across multiple LLM providers
Backend Developers — generate sub-keys for new microservices and verify model routing availability without leaving your IDE

Frequently asked questions

Give your AI agents the power of LiteLLM

Access LiteLLM and 2,000+ MCP servers — ready for your agents to use, right now. No glue code. No custom integrations. Just plug Vinkius AI Gateway and let your agents work.

DETAILS

CategoryAi Frontier

NVIDIA AI

9 tools

Access LLMs, embeddings, code generation, and reasoning via NVIDIA API Catalog.

Mem0

4 tools

Give your AI agent persistent memory — store, search, and recall facts, preferences, and context across sessions using the leading agent memory platform.

Bland AI

10 tools

Automate phone calls via Bland AI — send outbound calls, manage agents, and retrieve transcripts directly from any AI agent.

Denim

10 tools

Equip your AI agent to manage marketing campaigns, track contacts, and monitor analytics via the Denim API.

EIA Energy Outlook — Forecasts & Projections

4 tools

Official U.S. energy forecasts: the Short-Term Energy Outlook (18-month price and supply projections), Annual Energy Outlook (30-year U.S. projections), International Energy Outlook (world projections), and country-level global energy data.

TomTom

10 tools

Equip your AI agent with global mapping, routing, and real-time traffic capabilities powered by TomTom.