How to Use the Dify.AI SDK MCP in LlamaIndex
Index live Dify workflow runs and chat histories into LlamaIndex vector stores for semantic search.
Works with every AI agent you already use
…and any MCP-compatible client
Connect Dify.AI SDK MCP to LlamaIndex
Create your Vinkius account to connect Dify.AI SDK to LlamaIndex and route execution through our secure gateway. The platform manages server hosting, runtime updates, and security layers. Configuration requires no manual server provisioning.
Index Dify Chat History for LlamaIndex RAG
Pull raw conversational data using `get_conversations` and `get_conversation_messages` to feed your indexers. LlamaIndex turns these historical logs into searchable vector embeddings so your agent can query past user interactions. This MCP Server lets your query engine search through these embeddings to find relevant context before calling `chat_message`. Your agent avoids repeating answers and grounds its responses in actual past conversations.
Query Dify App Metadata Dynamically
Let your LlamaIndex router query `get_app_meta` and `get_workflow_info` using this MCP Server to understand the capabilities of your active Dify deployments. This metadata helps the query engine decide which specific Dify application to target for a given user prompt. If the router selects a workflow, it calls `get_workflow_parameters` to map the incoming query fields to the required schema. The engine then triggers the execution using `run_workflow` with zero manual mapping.
Synthesize Search Results into Dify Completions
Send retrieved context documents directly to Dify using the `send_completion` tool. LlamaIndex packages the raw search hits and lets the Dify completion engine format the final output. If the user wants to follow up on the generated answer, you can use `get_suggested_questions` to suggest the next logical queries. This keeps the search experience interactive and guided by the underlying Dify model logic.
Set up Dify.AI SDK MCP in LlamaIndex
Prerequisites
- Python 3.10+ installed
-
llama-index-tools-mcppackage - Active Vinkius subscription with a valid endpoint token
- 1
Install dependencies
Run
pip install llama-index-tools-mcp llama-index-llms-openai. The MCP tools package providesBasicMCPClientandMcpToolSpec. - 2
Connect with BasicMCPClient
Point
BasicMCPClientto your Vinkius endpoint URL. Replace[YOUR_TOKEN_HERE]with your token from cloud.vinkius.com. Supports SSE and Streamable HTTP transports. - 3
Convert to LlamaIndex tools
Call
mcp_tool_spec.to_tool_list_async()to convert all Dify.AI SDK MCP tools into nativeFunctionToolobjects that any LlamaIndex agent can use. - 4
Run with any LLM
Create a
FunctionAgentwith the tools and your preferred LLM. SwapOpenAIforAnthropic,Gemini, or any LlamaIndex-supported provider.
from llama_index.tools.mcp import BasicMCPClient, McpToolSpec
from llama_index.core.agent.workflow import FunctionAgent
from llama_index.llms.openai import OpenAI
# Connect to the MCP
mcp_client = BasicMCPClient(
"https://edge.vinkius.com/[YOUR_TOKEN_HERE]/mcp"
)
mcp_tool_spec = McpToolSpec(client=mcp_client)
# Convert MCP tools to LlamaIndex tools
tools = await mcp_tool_spec.to_tool_list_async()
# Create and run the agent
agent = FunctionAgent(
tools=tools,
llm=OpenAI(model="gpt-4o"),
system_prompt="You have access to Dify.AI SDK tools.",
)
response = await agent.run("List recent Dify.AI SDK data") Independent Platform Disclaimer: Vinkius is an independent platform and is not affiliated with, endorsed by, sponsored by, verified by, or otherwise authorized by Dify.AI. All third-party trademarks, logos, and brand names are the property of their respective owners. Their use on this website is strictly for informational purposes to identify service compatibility and interoperability.
Why Choose Vinkius
Vinkius connects your tools to AI with real-time monitoring and automatic cost savings — all from one dashboard.
Real-time monitoring
Live
visibility into every interaction
Connect your favorite tools to your AI and see exactly what's happening — every request, every response, in real time.
Built-in savings
60%
lower AI costs
Vinkius compresses data between your apps and your AI automatically. Lower bills every month — no configuration required.
Single dashboard
One
place for every integration
Every tool your AI connects to, managed from a single screen. One account, complete control.
Common questions about Dify.AI SDK MCP in LlamaIndex
Use it with your favorite AI tools
Connect this server to Cursor, Claude, VS Code, and more.
Start using the Dify.AI SDK MCP today
We host it, we monitor it, we maintain it. You just paste one token.