How to Use the Datadog AI (LLM Observability) MCP in LangChain
Track token usage and monitor LLM performance across your LangChain chains with real-time Datadog observability.
Works with every AI agent you already use
…and any MCP-compatible client
Connect Datadog AI (LLM Observability) MCP to LangChain
Create your Vinkius account to connect Datadog AI (LLM Observability) to LangChain and route execution through our secure gateway. The platform manages server hosting, runtime updates, and security layers. Configuration requires no manual server provisioning.
Trace LangChain tool execution in Datadog
Your LangChain agent can now inspect performance metrics directly inside your runs by calling `query_metrics`. By executing this tool, the agent grabs token counts like `datadog.llm_observability.tokens` to adjust its next chain link dynamically. This means your chain doesn't run blind. If a step spikes in latency, the agent catches it and routes the next call to a cheaper model.
Automate incident response during chain runs
When a step in your LangChain pipeline fails, your agent uses `list_incidents` to check if a wider system outage is causing the issue. It stops guessing whether the LLM or the infrastructure is broken. The agent then calls `create_event` to flag the failure directly in your team's Datadog dashboard. You get immediate visibility without manually parsing raw terminal logs.
Audit live prompts and span data
This MCP Server lets your chain call `search_llm_spans` to pull actual prompt payloads and response times directly from your active Datadog environment. You can audit everything in real time. Your chain gets the exact context it needs to evaluate its own performance. It can inspect raw trace arrays on the fly to flag bad outputs before they reach your users.
Set up Datadog AI (LLM Observability) MCP in LangChain
Prerequisites
- Python 3.10+ installed
-
langchain-mcp-adapters+langgraphpackages - Active Vinkius subscription with a valid endpoint token
- 1
Install dependencies
Run
pip install langchain-mcp-adapters langgraph langchain-openai. The MCP adapters package converts MCP tools into native LangChainBaseToolobjects. - 2
Connect via HTTP transport
Use
MultiServerMCPClientwith"transport": "http"pointing to your Vinkius endpoint. Replace[YOUR_TOKEN_HERE]with your token from cloud.vinkius.com. - 3
Create a ReAct agent
Pass the discovered tools to
create_react_agent()from LangGraph. The agent automatically routes Datadog AI (LLM Observability) tool calls through the MCP protocol. - 4
Run with any LLM
Swap
ChatOpenAIforChatAnthropic,ChatGoogleGenerativeAI, or any LangChain-compatible model. The MCP tools work identically across all providers.
from langchain_mcp_adapters.client import MultiServerMCPClient
from langgraph.prebuilt import create_react_agent
from langchain_openai import ChatOpenAI
async with MultiServerMCPClient({
"datadog-ai-llm-observability-mcp": {
"transport": "http",
"url": "https://edge.vinkius.com/[YOUR_TOKEN_HERE]/mcp",
}
}) as client:
tools = client.get_tools()
agent = create_react_agent(
ChatOpenAI(model="gpt-4o"),
tools,
)
result = await agent.ainvoke({
"messages": "List recent Datadog AI (LLM Observability) transactions"
})
print(result["messages"][-1].content) Independent Platform Disclaimer: Vinkius is an independent platform and is not affiliated with, endorsed by, sponsored by, verified by, or otherwise authorized by Datadog. All third-party trademarks, logos, and brand names are the property of their respective owners. Their use on this website is strictly for informational purposes to identify service compatibility and interoperability.
Why Choose Vinkius
Vinkius connects your tools to AI with real-time monitoring and automatic cost savings — all from one dashboard.
Real-time monitoring
Live
visibility into every interaction
Connect your favorite tools to your AI and see exactly what's happening — every request, every response, in real time.
Built-in savings
60%
lower AI costs
Vinkius compresses data between your apps and your AI automatically. Lower bills every month — no configuration required.
Single dashboard
One
place for every integration
Every tool your AI connects to, managed from a single screen. One account, complete control.
Common questions about Datadog AI (LLM Observability) MCP in LangChain
Use it with your favorite AI tools
Connect this server to Cursor, Claude, VS Code, and more.
Start using the Datadog AI (LLM Observability) MCP today
We host it, we monitor it, we maintain it. You just paste one token.