NVIDIA NIM Connector for AI agents.
8 live capabilities
Manage GPU telemetry and inference hardware limits in real time.
Waiting for input…
Why people use NVIDIA NIM
NVIDIA NIM GPU Telemetry for MLOps Engineers
This Connector puts all those metrics into your agent's hands. You just ask "Is the model ready?" and it checks the health probes and memory status for you. You get a clear answer in seconds instead of hunting through logs.
What Vinkius changes
You get a real-time window into your hardware health through a single chat interface.
Use it from Claude, ChatGPT, Cursor or another AI client you already have.
One account · 5,900+ Connectors
- Real-world use case 01
Identifying a bottleneck
The model is slow.
- Real-world use case 02
Confirming a successful deploy
You just pushed a new model.
- Real-world use case 03
Handling a traffic spike
User demand is jumping.
Complete set · 8capabilities
The complete NVIDIA NIM capability set.
These are the exact actions your AI can choose when you ask it to work with NVIDIA NIM.
01—04
4 capabilities in this set.
Part of 8 available through NVIDIA NIM.
- 01 Capability
Nim check health live
Check if the host container is actually responsive and alive. This helps you skip dead nodes during deployment.
- 02 Capability
Nim check health ready
See if the GPU inference layers finished loading your model artifacts. Use this to confirm your model is ready for use.
- 03 Capability
Nim get container logs
Grab the latest stdout logs to see what the orchestrator is doing. It's great for debugging container crashes.
- 04 Capability
Nim get gpu status
Get a clean look at GPU memory variables and topological limits. This helps you spot memory bottlenecks quickly.
05—08
4 capabilities in this set.
Part of 8 available through NVIDIA NIM.
- 05 Capability
Nim get metadata
Pull the configuration bounds for the loaded engine. It gives you the logical metrics for your current setup.
- 06 Capability
Nim get metrics
Pull hardware scaling metrics directly from Prometheus endpoints. You can see real-time scaling data without extra capabilities.
- 07 Capability
Nim list models
See a list of every active LLM currently on your backend array. This ensures you know exactly what's running.
- 08 Capability
Nim scale replicas
Change the number of hardware replication assignments on the fly. This is your primary capability for dynamic scaling.
Set up in minutes
One URL. Then ask NVIDIA NIM to work.
Claude and ChatGPT only need the Connector URL. Copy it once, add it in settings, and use NVIDIA NIM from the conversation.
Choose your client
Live previewAdvanced clients IDE · CLI
Claude · Web + desktop
Connector URL · ready to paste
Streamable HTTPhttps://edge.vinkius.com/vk_preview_70BV0qtRSn6oYi65LbVY4KDoGOvWiulNTIr6cS4G/mcp - Step 01
Open Connectors
In Claude Web or Claude Desktop, open Settings and choose Connectors.
- Step 02
Add the URL
Choose Add custom connector, name it NVIDIA NIM, and paste the URL above.
- Step 03
Turn it on in chat
Select +, open Connectors, and enable NVIDIA NIM for the conversation.
ChatGPT · Web + desktop
Connector URL · ready to paste
Streamable HTTPhttps://edge.vinkius.com/vk_preview_70BV0qtRSn6oYi65LbVY4KDoGOvWiulNTIr6cS4G/mcp - Step 01
Open MCP settings
On desktop, open Settings and MCP servers. On web, open your workspace app or connector settings.
- Step 02
Add the URL
Choose Add server with Streamable HTTP, or create a custom MCP app, then paste the NVIDIA NIM URL.
- Step 03
Save and start
Save the connection and enable NVIDIA NIM in your conversation. Desktop may ask you to restart once.
Cursor · IDE configuration
Advanced setup
{
"mcpServers": {
"nvidia-nim": {
"url": "https://edge.vinkius.com/vk_preview_70BV0qtRSn6oYi65LbVY4KDoGOvWiulNTIr6cS4G/mcp"
}
}
}- Step 01
Open MCP Settings
Press Cmd+Shift+P (macOS) or Ctrl+Shift+P (Windows/Linux) → search "MCP Settings"
- Step 02
Add the server config
Paste the JSON configuration above into the mcp.json file that opens
- Step 03
Save the file
Cursor will automatically detect the new Connector
- Step 04
Start using NVIDIA NIM
Open Agent mode in chat and ask: "Using NVIDIA NIM, help me...". 8 tools available
VS Code Copilot · IDE configuration
Advanced setup
{
"mcpServers": {
"nvidia-nim": {
"url": "https://edge.vinkius.com/vk_preview_70BV0qtRSn6oYi65LbVY4KDoGOvWiulNTIr6cS4G/mcp"
}
}
}- Step 01
Create MCP config
Create a .vscode/mcp.json file in your project root
- Step 02
Add the server config
Paste the JSON configuration above
- Step 03
Enable Agent mode
Open GitHub Copilot Chat and switch to Agent mode using the dropdown
- Step 04
Start using NVIDIA NIM
Ask Copilot: "Using NVIDIA NIM, help me...". 8 tools available
Windsurf · IDE configuration
Advanced setup
{
"mcpServers": {
"nvidia-nim": {
"url": "https://edge.vinkius.com/vk_preview_70BV0qtRSn6oYi65LbVY4KDoGOvWiulNTIr6cS4G/mcp"
}
}
}- Step 01
Open MCP Settings
Go to Settings → MCP Configuration or press Cmd+Shift+P and search "MCP"
- Step 02
Add the server
Paste the JSON configuration above into mcp_config.json
- Step 03
Save and reload
Windsurf will detect the new server automatically
- Step 04
Start using NVIDIA NIM
Open Cascade and ask: "Using NVIDIA NIM, help me...". 8 tools available
Cline · IDE configuration
Advanced setup
{
"mcpServers": {
"nvidia-nim": {
"url": "https://edge.vinkius.com/vk_preview_70BV0qtRSn6oYi65LbVY4KDoGOvWiulNTIr6cS4G/mcp"
}
}
}- Step 01
Open Cline MCP Settings
Click the Connectors icon in the Cline sidebar panel
- Step 02
Add remote server
Click "Add Connector" and paste the configuration above
- Step 03
Enable the server
Toggle the server switch to ON
- Step 04
Start using NVIDIA NIM
Ask Cline: "Using NVIDIA NIM, help me...". 8 tools available
Claude Code · Terminal command
Advanced setup
claude mcp add nvidia-nim --transport http "https://edge.vinkius.com/vk_preview_70BV0qtRSn6oYi65LbVY4KDoGOvWiulNTIr6cS4G/mcp"- Step 01
Install Claude Code
Run npm install -g @anthropic-ai/claude-code if not already installed
- Step 02
Add the Connector
Run the command above in your terminal
- Step 03
Verify the connection
Run claude mcp to list connected servers, or type /mcp inside a session
- Step 04
Start using NVIDIA NIM
Ask Claude: "Using NVIDIA NIM, show me...". 8 tools are ready
Where the request belongs
Work NVIDIA NIM can move forward.
This is for the MLOps engineer who's tired of manually checking GPU stats at 2am or the infrastructure admin trying to scale inference without breaking the hardware limits.
MLOps Engineer
Checking if a specific model is actually loaded and ready for traffic during a production rollout.
Infrastructure Integrator
Auditing physical hardware bounds across multiple docker endpoints to ensure stable deployment.
Hardware Proxy Admin
Scaling replicas across a cluster to handle sudden spikes in user demand without manual intervention.
Build the capability set
Add more capabilities.
Each Connector adds new actions and data without changing how you work.
Browse ConnectorsVast.ai (GPU Rental Cloud API)
Rent high-performance GPUs for AI and deep learning. Search marketplace offers, deploy Docker containers, and manage your cloud GPU fleet.
CoreWeave (AI GPU Cloud)
Manage high-performance AI infrastructure on CoreWeave. provision GPU clusters, configure VPCs, and orchestrate inference gateways directly from your AI agent.
RunPod
Integrate your AI securely to RunPod to cleanly quickly provision scalable GPU pods, manage active instances, and inspect serverless endpoints and custom templates natively.
Lambda Labs (GPU Cloud)
Manage AI infrastructure via Lambda Labs. launch GPU instances, monitor ML workloads, and manage SSH keys.
Neptune.ai (ML Experiment Tracking)
Manage ML experiments via Neptune.ai. track training runs, monitor metrics, and audit model versions.
NVIDIA API Catalog
Cloud Engine proxy running native foundational completions natively utilizing active Nemotron and Llama3 architectures.
Bring your own AI
Change the model, client or framework. Keep NVIDIA NIM connected.
-
Claude -
ChatGPT -
Gemini -
Cursor -
VS Code -
Windsurf -
ZCode -
Cline -
Zed -
Continue -
Kiro -
Roo Code -
Zencoder -
Goose -
Void -
Augment Code -
Amp -
Qodo -
Tabnine -
Pieces -
Sourcegraph Cody -
JetBrains -
Warp -
Amazon Q -
Antigravity -
BoltAI -
Raycast -
Jan -
LM Studio -
AnythingLLM -
Open WebUI -
Msty -
Cherry Studio -
LibreChat -
TypingMind -
Chorus -
5ire -
n8n -
LangChain -
LlamaIndex -
CrewAI -
Vercel AI SDK
Before you connect
Questions about NVIDIA NIM.
The practical details behind the request, access and result.
Is NVIDIA NIM MCP for production MLOps use?
Yes, it is specifically designed for production MLOps. It allows you to monitor live hardware telemetry and manage inference scaling in real time.
Can NVIDIA NIM MCP help me prevent Out of Memory errors?
Yes, it can. By using the GPU status capability, your agent can check actual memory limits and variables before you deploy a model.
Does the NVIDIA NIM MCP work with Prometheus?
Yes, it can pull hardware scaling metrics directly from Prometheus endpoints, giving you a unified view of your infrastructure.
Can I use NVIDIA NIM MCP to scale my inference replicas?
Yes, it includes a specific capability to dynamically adjust hardware replication assignments, making it easy to scale up or down.
Does NVIDIA NIM MCP work for local GPU setups?
Yes, it can map local hardware limits to your logical proxy, providing the same telemetry for local setups as it does for remote clusters.
How does NVIDIA NIM MCP help with debugging?
It lets your agent fetch container logs directly. This means you can find out why a container crashed without needing to access the terminal manually.
Can I explicitly track GPU hardware analytics natively using the NIM MCP integration?
Yes! Utilize get_metrics exposing Prometheus-compatible proxy limits tracking explicit hardware latencies easily natively securely.
How do I explicitly evaluate if my container instances mapped properly loaded native Foundation Models?
Target UUID probes natively mapped executing check_health_ready verifying bounds catching limits generating exact readiness states cleanly.
Does this call inference proxies executing completions bounds mapped dynamically?
No, this is infrastructure proxy bounding explicitly container node management. Utilize nvidia-catalog-mcp enforcing natively hosted inference bounds efficiently.
One connection away
Give your agent a direct line to NVIDIA NIM.
Connect NVIDIA NIM once. Keep it beside 5,900+ managed Connectors when the next task needs more.
Explore every Connector No credit card required · Free tier available