Bring Video Search
to OpenAI Agents SDK
Learn how to connect Twelve Labs (Video Understanding) to OpenAI Agents SDK and start using 18 AI agent tools in minutes. Fully managed, enterprise secure, and ready to use without writing a single line of code.
Compatible with every major AI agent and IDE
What is the Twelve Labs (Video Understanding) MCP Server?
Connect Twelve Labs to your AI agent to unlock the full potential of video understanding. This server allows your agent to index video files, perform complex semantic searches, and generate deep analytical insights from visual and audio data.
What you can do
- Video Indexing — Create and manage indexes to organize your video library for rapid retrieval and analysis.
- Semantic Search — Query your video content using natural language to find specific moments, objects, or actions without manual tagging.
- Asset Management — Upload videos via URLs or multipart sessions and monitor their indexing status in real-time.
- Deep Analysis — Run synchronous or asynchronous analysis tasks to extract structured data from your video assets.
- Embeddings & Entities — Generate multimodal embeddings and manage entity collections for advanced machine learning workflows.
How it works
- Subscribe to this server
- Enter your Twelve Labs API Key
- Start querying your video data from Claude, Cursor, or any MCP-compatible client
Transform your video archives into searchable, actionable data. Your AI can now 'watch' and understand hours of footage in seconds.
Who is this for?
- Content Creators & Media Teams — quickly find b-roll or specific scenes across massive video libraries.
- Security & Operations — search through hours of footage for specific events or objects using natural language.
- Developers — integrate state-of-the-art video understanding into your AI workflows without building complex pipelines.
Built-in capabilities (18)
Analyze and segment videos asynchronously
Analyze and segment videos synchronously
Confirm a multipart upload
Upload content to create an asset
g., a person) within a collection. Create an entity
Create an entity collection
Create a new index
Create a multipart upload session
Delete an index
Create embeddings asynchronously
Create embeddings synchronously
Retrieve an index by ID
Retrieve an indexed asset
Index an uploaded asset
List all indexes
Report progress for a multipart upload
Search for moments in videos
Update an index name
Why OpenAI Agents SDK?
The OpenAI Agents SDK auto-discovers all 18 tools from Twelve Labs (Video Understanding) through native MCP integration. Build agents with built-in guardrails, tracing, and handoff patterns. chain multiple agents where one queries Twelve Labs (Video Understanding), another analyzes results, and a third generates reports, all orchestrated through Vinkius.
- —
Native MCP integration via
MCPServerSse, pass the URL and the SDK auto-discovers all tools with full type safety - —
Built-in guardrails, tracing, and handoff patterns let you build production-grade agents without reinventing safety infrastructure
- —
Lightweight and composable: chain multiple agents and MCP servers in a single pipeline with minimal boilerplate
- —
First-party OpenAI support ensures optimal compatibility with GPT models for tool calling and structured output
Twelve Labs (Video Understanding) in OpenAI Agents SDK
Twelve Labs (Video Understanding) and 4,000+ other MCP servers. One platform. One governance layer.
Teams that connect Twelve Labs (Video Understanding) to OpenAI Agents SDK through Vinkius don't need to source, host, or maintain individual MCP servers. Every tool call runs inside a hardened runtime with credential isolation, DLP, and a signed audit chain.
Raw MCP | Vinkius | |
|---|---|---|
| Server catalog | Find and host yourself | 4,000+ managed |
| Infrastructure | Self-hosted | Sandboxed V8 isolates |
| Credential handling | Plaintext in config | Vault + runtime injection |
| Data loss prevention | None | Configurable DLP policies |
| Kill switch | None | Global instant shutdown |
| Financial circuit breakers | None | Per-server limits + alerts |
| Audit trail | None | Ed25519 signed logs |
| SIEM log streaming | None | Splunk, Datadog, Webhook |
| Honeytokens | None | Canary alerts on leak |
| Custom domains | Not applicable | DNS challenge verified |
| GDPR compliance | Manual effort | Automated purge + export |
Why teams choose Vinkius for Twelve Labs (Video Understanding) in OpenAI Agents SDK
The Twelve Labs (Video Understanding) MCP Server runs on Vinkius-managed infrastructure inside AWS — a purpose-built runtime with per-request V8 isolates, Ed25519 signed audit chains, and sub-40ms cold starts. All 18 tools execute in hardened sandboxes optimized for native MCP execution.
Your AI agents in OpenAI Agents SDK only access the data you authorize, with DLP that blocks sensitive information from ever reaching the model, kill switch for instant shutdown, and up to 60% token savings. Enterprise-grade infrastructure, zero maintenance.

* Every MCP server runs on Vinkius-managed infrastructure inside AWS - a purpose-built runtime with per-request V8 isolates, Ed25519 signed audit chains, and sub-40ms cold starts optimized for native MCP execution. See our infrastructure
How Vinkius secures
Twelve Labs (Video Understanding) for OpenAI Agents SDK
Every tool call from OpenAI Agents SDK to the Twelve Labs (Video Understanding) MCP Server is protected by DLP redaction, cryptographic audit chains, V8 sandbox isolation, kill switch, and financial circuit breakers.
Frequently asked questions
How do I list all my existing video indexes?
You can use the list_indexes tool. It will return a list of all indexes available in your Twelve Labs account, including their IDs and configuration.
Can I search for a specific moment inside my videos using text?
Yes! Use the search tool by providing an index_id and a search query. The AI will find the most relevant timestamps and video segments based on your description.
How do I add a new video to an index for analysis?
First, use create_asset with a public URL to upload the video. Then, use the index_asset tool with the resulting asset_id and your target index_id to start the processing.
How does the OpenAI Agents SDK connect to MCP?
Use MCPServerSse(url=...) to create a server connection. The SDK auto-discovers all tools and makes them available to your agent with full type information.
Can I use multiple MCP servers in one agent?
Yes. Pass a list of MCPServerSse instances to the agent constructor. The agent can use tools from all connected servers within a single run.
Does the SDK support streaming responses?
Yes. The SDK supports SSE and Streamable HTTP transports, both of which work natively with Vinkius.
MCPServerStreamableHttp not found
Ensure you have the latest version: pip install --upgrade openai-agents
Agent not calling tools
Make sure your prompt explicitly references the task the tools can help with.
Explore More MCP Servers
View all →
PingCode
10 toolsAgile project management and R&D collaboration platform — manage work items, sprints, and wiki pages via AI.

USDA FoodData Central Alternative
Manage your nutritional research — audit food records and nutrient data via AI.

Cube.dev
15 toolsAccess your Cube semantic layer — execute queries, inspect generated SQL, manage pre-aggregations, and explore data metadata directly.

AppsFlyer (Pull API)
7 toolsRetrieve raw and aggregate attribution data from AppsFlyer — track installs, events, and performance via AI.
