Download PDFMarkdown Version
ClaudeChatGPTPerplexityGeminiMicrosoft CopilotRaycastMeta AIGrokZ.aiQwenKimi
DeepSeekMistralCursorVS CodeWindsurfJetBrainsClineLovableVercel AI SDKLangChain

Use GPU Inference Memory Calculator with your AI.

Connect your account once and let the AI you already use work with it, without building another integration. Estimate GPU VRAM requirements for LLM inference based on model parameters, precision, and batch size.

Included with plan

Ask AI about this Connector

Developed, maintained, and hosted by Vinkius.

MCP VERIFIED · PRODUCTION READY · VINKIUS GUARANTEED

Waiting for input…

Works with modern AI clients that support MCP, including ChatGPT, Claude, Cursor, and more.

ChatGPTClaudeCursorPerplexityGeminiMicrosoft CopilotRaycastMeta AI

Complete set · 4 capabilities

The complete GPU Inference Memory Calculator capability set.

These are the exact actions your AI can choose when you ask it to work with GPU Inference Memory Calculator.

Capability set01 / 01

01-04

4 capabilities in this set.

Part of 4 available through GPU Inference Memory Calculator.

  1. 01

    Estimate total vram

    Calculates the total VRAM required to run a specific batch size

  2. 02

    Calculate max batch capacity

    Determines the largest possible batch size that can fit within a specific GPU's memory limit

  3. 03

    Get kv cache per request

    Calculates the memory footprint of the Key-Value cache for a single inference request

  4. 04

    Get model weights size

    G., FP32, FP16, BF16, INT8, INT4). Calculates the amount of VRAM required just to load the model's parameters

Observed, not estimated

646ms average. Fast in production.

GPU Inference Memory Calculator is checked daily against the live service.

Daily averagePeak 805ms
Aug 20Today
Fastest day
504ms
Slowest day
805ms
14-day trend
Slowing+51%

Connect your client

One URL. Every client.

Activate the Connector, copy your link, and paste it into the client you already use. 4 capabilities arrive ready to run.

Preview access · not provider authentication

The vk_preview_* token belongs to Vinkius preview infrastructure. It lets Claude discover and display the capabilities of GPU Inference Memory Calculator, so you can see the experience inside your AI.

It does not authenticate your account with GPU Inference Memory Calculator. Actions requiring credentials or live account data may not run until you activate the Connector and authorize the service.

GPU Inference Memory Calculator Connector

You're all set. Choose your MCP client and follow the setup instructions.

Connector linkhttps://edge.vinkius.com/vk_preview_Po32HLoFfJyACkPs6caCBt7wRipx1gN5av2RafWO/mcp

Claude Desktop

Follow the steps below to connect in seconds.

  1. 1In Claude Desktop, open Settings → Connectors.
  2. 2Click “Add custom connector” and paste the connector link above as the remote MCP server URL.
  3. 3Click Add and start a new chat — GPU Inference Memory Calculator capabilities are ready to use.
Configuration · claude_desktop_config.jsonCopy
{
  "mcpServers": {
    "gpu-inference-memory-calculator-mcp": {
      "url": "https://edge.vinkius.com/vk_preview_Po32HLoFfJyACkPs6caCBt7wRipx1gN5av2RafWO/mcp"
    }
  }
}
  • Claude
  • ChatGPT
  • Cursor
  • VS Code
  • Windsurf
  • Claude Code
  • JetBrains
  • Cline

Step-by-step instructions for each client are in the guide. How to connect

FAQ

Questions GPU Inference Memory Calculator owners ask.

  • 01

    What precision modes are supported?

    The calculator supports FP32, FP16, BF16, INT8, and INT4 precision modes.

  • 02

    How do I calculate the total VRAM for a batch?

    You can use the estimate_total_vram capability by providing the pre-calculated weight memory, KV cache size per request, and your desired batch size.

  • 03

    Can I determine the maximum number of concurrent requests for my GPU?

    Yes, use calculate_max_batch_capacity by providing your total VRAM budget, model weight memory, and KV cache size per request.

Explore

More in LLM Inference

Suggestions