• SERVICE
  • ROUTE
  • PLUGIN
  • HUMAN

How to configure AI proxy routing with your AI

Connect your agent to Kong and let it handle the heavy lifting of API gateway management. You just tell it what routes you need.

Ask AI about this page

Short answer

How can I use my AI to manage Kong AI proxy routing?

Your agent uses the Kong MCP to create services, define routes, and apply AI plugins directly to your gateway. This lets you manage how LLM traffic flows through your infrastructure using natural language. You'll see the specific configuration steps below.

Where every change lands.

Routing outcomes

The AI maps your requests to these specific gateway states.

SERVICE

New API endpoints

The agent sets up the base service definitions in Kong. You get a clean entry point for your LLM traffic.

ROUTE

Traffic paths

Your agent maps specific paths to those services. This controls exactly where incoming requests go.

PLUGIN

AI proxy logic

The agent applies the ai-proxy plugin to your routes. This enables the actual LLM routing capabilities.

HUMAN

Manual review

You decide when to update or delete existing configurations. The AI won't touch your existing setup without a direct command.

The workflow

What your AI does when a routing request arrives.

The agent translates your intent into specific Kong API calls.

  1. Define the endpoint

    The agent establishes the target service within your Kong gateway.

    create_service

  2. Map the path

    It creates the specific URL paths that will trigger the service.

    create_route

  3. Enable AI features

    The agent attaches the necessary AI proxy logic to the route.

    create_ai_plugin

  4. Adjust settings

    If you need to change how a plugin behaves, the agent modifies it.

    update_plugin

Try it

Copy these to start.

Use these prompts to kick off your configuration.

Starting points

Swap out the service names and plugin settings for your specific Kong setup.

Kong Connector

You're all set. Choose your MCP client and follow the setup instructions.

Connector linkhttps://edge.vinkius.com/vk_preview_v0JAMPJEymFJeA5BOdGXfYEBh1b3USJtcGdqANfK/mcp

Claude Desktop

Follow the steps below to connect in seconds.

  1. 1In Claude Desktop, open Settings → Connectors.
  2. 2Click “Add custom connector” and paste the connector link above as the remote MCP server URL.
  3. 3Click Add and start a new chat — Kong capabilities are ready to use.
Configuration · claude_desktop_config.jsonCopy
{
  "mcpServers": {
    "kong-ai-api-gateway-mcp": {
      "url": "https://edge.vinkius.com/vk_preview_v0JAMPJEymFJeA5BOdGXfYEBh1b3USJtcGdqANfK/mcp"
    }
  }
}
Copy into chat04

  • Create a new service in Kong named 'llm-gateway' and add a route for '/v1/chat'.

  • Apply the ai-proxy plugin to my existing '/completions' route.

  • Update the ai-proxy plugin on the 'openai-route' to change the model provider.

  • Set up a new service called 'anthropic-proxy' with a route at '/v1/messages'.

  • Claude
  • ChatGPT
  • Cursor
  • VS Code
  • Windsurf
  • Claude Code
  • JetBrains
  • Cline

Start here

Connect Kong once, then ask.

Log in once to link your Kong instance. Your credentials stay encrypted, and you can immediately start managing routes through your agent.

Connect Kong to your AI

FAQ

Common questions

  • 01

    Can the AI delete my existing routes?

    No. The current tools only allow for creating and updating configurations. You must handle deletions manually.

  • 02

    Will my Kong admin API key be exposed?

    No. Your credentials are encrypted and handled by Vinkius; they aren't visible in your chat history.

  • 03

    Can the AI monitor my traffic latency?

    No. This MCP is for configuration and management, not for real-time telemetry or monitoring.

  • 04

    Does the AI handle the actual LLM inference?

    No. The AI configures the Kong proxy to route the traffic, but the actual model processing happens at the provider level.

  • 05

    Can I use this to manage non-AI plugins?

    The specific tools provided here are focused on service, route, and AI plugin management.

  • More questions about Kong? The Connector page answers them. See everything the Kong Connector can do

Connect Kong to Claude, Cursor, ChatGPT & more