Skip to content
Vinkius

Connect New Relic AI Observability MCP for AI Agents

Monitor LLM Performance and Token Costs in Real-Time

We take care of the infrastructure, maintenance, security, and governance. Works with:

New Relic AI Observability MCP for AI Agents MCP is compatible with Claude Claude
New Relic AI Observability MCP for AI Agents MCP is compatible with ChatGPT ChatGPT
New Relic AI Observability MCP for AI Agents MCP is compatible with Cursor Cursor
New Relic AI Observability MCP for AI Agents MCP is compatible with Gemini Gemini
Windsurf
VS Code
Vercel
See All Capabilities

No credit card required. Experience the power of this integration risk-free.

Waiting for input…

AI Agent

What AI agents can do with New Relic AI Observability: 10 Tools for LLM Performance Analysis

Use these specific tools to run deep queries on error logs, token costs, latency data, and system components from your New Relic monitoring platform.

List alert policies

Checks internal arrays for specific automated alerts that might be triggering issues in your system.

List apm apps

Automates a validation check to see which core services or gateways are currently active and running.

Custom nrql

Runs complex, read-only queries using New Relic Query Language (NRQL) to extract detailed insights from your data.

List dashboards

Identifies which monitoring dashboards are currently active and available for viewing within the platform.

Query llm errors

Checks for specific error records related to LLM processing, helping you quickly spot failures in your generation process.

Query llm costs

Performs extraction of properties that calculate the precise dollar cost associated with running your AI models.

Query llm events

Gathers specific records detailing events related to LLM usage within the New Relic platform.

Query llm feedback

Retrieves explicit user feedback and rating scores provided by human reviewers for your model outputs.

Query llm latency

Provides data on how fast your LLM responses are, including key metrics like the 95th percentile latency.

Post custom event

Adds custom telemetry rows to track specific internal states or behavioral markers for deeper monitoring.

Frequently Asked Questions

How does New Relic AI Observability help me track my spending on LLMs? +

It calculates your total token cost by extracting the usage data from all your models. You get a clear, dollar-based report that shows exactly how much each model costs you over time.

Can New Relic AI Observability tell me if my model is running slowly? +

Yes, it measures performance by providing the 95th percentile (p95) latency. You can ask for this data to see if your responses are meeting their speed goals.

Is New Relic AI Observability better than just looking at dashboards? +

It's much faster because you don't have to click around. Instead, you ask a natural language question—like 'What went wrong?'—and it pulls the right data from multiple sources automatically.

Does New Relic AI Observability help me understand what users think of my model? +

Yes, it gathers and displays human feedback. You can retrieve rating scores and comments, letting you identify quality issues quickly after deployment.

Can I check my total AI token costs through my agent? +

Yes. Use the query_llm_costs tool. Your agent will execute a NRQL aggregation summing the tokenSpanCost property from your LLM events over the last 24 hours, faceted by model, to provide a clear financial breakdown.

How do I monitor the p95 latency of my LLM generations? +

The query_llm_latency tool retrieves the average duration and latency matrices for your AI providers. Your agent will report the results as a timesheet or summary, helping you identify performance bottlenecks instantly.

Can my agent run custom NRQL queries against my telemetry data? +

Absolutely. Use the custom_nrql tool to provide any valid read-only NRQL string. Your agent will query New Relic's NerdGraph API and return the resulting dataset, allowing for complete flexibility in how you analyze your AI operations.

Other MCPs in this category

Related MCPs

Your AI, connected to everything.

Connect New Relic AI (LLM Observability) and 5,600+ more MCP servers to Claude, Cursor, or any AI you use.

No credit card required · Free tier available