Bring Video Search
to VS Code Copilot
Learn how to connect Twelve Labs (Video Understanding) to VS Code Copilot and start using 18 AI agent tools in minutes. Fully managed, enterprise secure, and ready to use without writing a single line of code.
GDPR Free for SubscribersCompatible with every major AI agent and IDE
Gemini
What is the Twelve Labs (Video Understanding) MCP Server?
Connect Twelve Labs to your AI agent to unlock the full potential of video understanding. This server allows your agent to index video files, perform complex semantic searches, and generate deep analytical insights from visual and audio data.
What you can do
- Video Indexing — Create and manage indexes to organize your video library for rapid retrieval and analysis.
- Semantic Search — Query your video content using natural language to find specific moments, objects, or actions without manual tagging.
- Asset Management — Upload videos via URLs or multipart sessions and monitor their indexing status in real-time.
- Deep Analysis — Run synchronous or asynchronous analysis tasks to extract structured data from your video assets.
- Embeddings & Entities — Generate multimodal embeddings and manage entity collections for advanced machine learning workflows.
How it works
- Subscribe to this server
- Enter your Twelve Labs API Key
- Start querying your video data from Claude, Cursor, or any MCP-compatible client
Transform your video archives into searchable, actionable data. Your AI can now 'watch' and understand hours of footage in seconds.
Who is this for?
- Content Creators & Media Teams — quickly find b-roll or specific scenes across massive video libraries.
- Security & Operations — search through hours of footage for specific events or objects using natural language.
- Developers — integrate state-of-the-art video understanding into your AI workflows without building complex pipelines.
Built-in capabilities (18)
Analyze and segment videos asynchronously
Analyze and segment videos synchronously
Confirm a multipart upload
Upload content to create an asset
g., a person) within a collection. Create an entity
Create an entity collection
Create a new index
Create a multipart upload session
Delete an index
Create embeddings asynchronously
Create embeddings synchronously
Retrieve an index by ID
Retrieve an indexed asset
Index an uploaded asset
List all indexes
Report progress for a multipart upload
Search for moments in videos
Update an index name
Why VS Code Copilot?
GitHub Copilot Agent mode brings Twelve Labs (Video Understanding) data directly into your VS Code workflow. With a project-scoped config, the entire team shares access to 18 tools. Copilot queries live data, generates typed code, and writes tests from actual API responses, all without leaving the editor.
- —
VS Code is used by over 70% of developers. adding MCP tools to Copilot means your team can leverage external data without leaving their primary editor
- —
Project-scoped MCP configs (
.vscode/mcp.json) let you commit server configurations to your repository, ensuring the entire team shares the same tool access - —
Copilot's Agent mode integrates MCP tools seamlessly with file editing, terminal commands, and workspace search in a single agentic loop
- —
GitHub's enterprise compliance and audit features extend to MCP tool usage, providing visibility into how AI interacts with external services
Twelve Labs (Video Understanding) in VS Code Copilot
Twelve Labs (Video Understanding) and 4,000+ other MCP servers. One platform. One governance layer.
Teams that connect Twelve Labs (Video Understanding) to VS Code Copilot through Vinkius don't need to source, host, or maintain individual MCP servers. Every tool call runs inside a hardened runtime with credential isolation, DLP, and a signed audit chain.
Raw MCP | Vinkius | |
|---|---|---|
| Server catalog | Find and host yourself | 4,000+ managed |
| Infrastructure | Self-hosted | Sandboxed V8 isolates |
| Credential handling | Plaintext in config | Vault + runtime injection |
| Data loss prevention | None | Configurable DLP policies |
| Kill switch | None | Global instant shutdown |
| Financial circuit breakers | None | Per-server limits + alerts |
| Audit trail | None | Ed25519 signed logs |
| SIEM log streaming | None | Splunk, Datadog, Webhook |
| Honeytokens | None | Canary alerts on leak |
| Custom domains | Not applicable | DNS challenge verified |
| GDPR compliance | Manual effort | Automated purge + export |
Why teams choose Vinkius for Twelve Labs (Video Understanding) in VS Code Copilot
The Twelve Labs (Video Understanding) MCP Server runs on Vinkius-managed infrastructure inside AWS — a purpose-built runtime with per-request V8 isolates, Ed25519 signed audit chains, and sub-40ms cold starts. All 18 tools execute in hardened sandboxes optimized for native MCP execution.
Your AI agents in VS Code Copilot only access the data you authorize, with DLP that blocks sensitive information from ever reaching the model, kill switch for instant shutdown, and up to 60% token savings. Enterprise-grade infrastructure, zero maintenance.
* Every MCP server runs on Vinkius-managed infrastructure inside AWS - a purpose-built runtime with per-request V8 isolates, Ed25519 signed audit chains, and sub-40ms cold starts optimized for native MCP execution. See our infrastructure
How Vinkius secures
Twelve Labs (Video Understanding) for VS Code Copilot
Every tool call from VS Code Copilot to the Twelve Labs (Video Understanding) MCP Server is protected by DLP redaction, cryptographic audit chains, V8 sandbox isolation, kill switch, and financial circuit breakers.
Frequently asked questions
How do I list all my existing video indexes?
You can use the list_indexes tool. It will return a list of all indexes available in your Twelve Labs account, including their IDs and configuration.
Can I search for a specific moment inside my videos using text?
Yes! Use the search tool by providing an index_id and a search query. The AI will find the most relevant timestamps and video segments based on your description.
How do I add a new video to an index for analysis?
First, use create_asset with a public URL to upload the video. Then, use the index_asset tool with the resulting asset_id and your target index_id to start the processing.
Which VS Code version supports MCP?
MCP support requires VS Code 1.99 or later with the GitHub Copilot extension. Ensure both are updated to the latest version. Older versions of Copilot may not expose the Agent mode toggle.
How do I switch to Agent mode?
Open the Copilot Chat panel and look for two mode options: "Ask" and "Agent". Click "Agent" to enable autonomous tool calling. In Ask mode, Copilot provides conversational answers but cannot invoke MCP tools.
Can I restrict which MCP tools Copilot can access?
Yes. VS Code shows a tool consent dialog before any MCP tool is invoked for the first time. You can also configure tool access policies at the organization level through GitHub Copilot settings.
Does MCP work in VS Code Remote or Codespaces?
Yes. MCP servers configured via .vscode/mcp.json work in Remote SSH, WSL, and GitHub Codespaces environments. The MCP connection is established from the remote host, so ensure the server URL is accessible from that environment.
MCP tools not available
Ensure you are in Agent mode in Copilot Chat. MCP tools only appear in Agent mode.
Explore More MCP Servers
View all →
Airbyte
7 toolsMonitor your Airbyte data pipelines via AI — track sync jobs, list sources, and check connections instantly.
Mattermost (Secure Team Collaboration)
10 toolsManage team collaboration via Mattermost — send messages, search channels, and audit team activities.
Linode (Akamai)
10 toolsManage Linode cloud infrastructure—provision compute instances, manage Kubernetes clusters (LKE), and monitor account details directly from your AI agent.
Goodreads
8 toolsThe world's largest site for readers and book recommendations — search books and audit reviews via AI.