Twelve Labs (Video Understanding) Connector for AI agents.

18 live capabilities

Search and analyze video content using natural language.

Live agent request Twelve Labs (Video Understanding) / Connector

Waiting for input…

AI Agent

Why people use Twelve Labs (Video Understanding)

Twelve Labs Video Understanding for Media Archive Management

This Connector lets your AI agent do that work for you. You can just ask it to find the scene where a person is using a specific capability, and it will give you the exact timestamp. You turn a multi-hour search into a few seconds of conversation.

What Vinkius changes

Your AI agent gets the ability to query and analyze video content as easily as it reads text.

Use it from Claude, ChatGPT, Cursor or another AI client you already have.

One account · 6,100+ Connectors

Real-world use case 01

Finding b-roll

A video editor asks the agent to find "a sunset over a mountain" in a 500-hour archive.
Real-world use case 02

Security review

A security lead asks "show me every time a person enters the back door.
Real-world use case 03

Content tagging

A media team wants to extract all product names from a series of ads.

Complete set · 18capabilities

The complete Twelve Labs (Video Understanding) capability set.

These are the exact actions your AI can choose when you ask it to work with Twelve Labs (Video Understanding).

Capability set01 / 05

01—04

4 capabilities in this set.

Part of 18 available through Twelve Labs (Video Understanding).

01 Capability
Embed async
Generate multimodal embeddings for a batch of videos in the background. This is great for building large-scale search databases.
02 Capability
Analyze async
Run video analysis in the background. This is useful for processing multiple files at once without waiting.
03 Capability
Analyze sync
Perform immediate video analysis for quick results. This works well when you need a fast answer on a single clip.
04 Capability
Confirm multipart upload
Finalize a multi-part upload session. This tells the system the file is ready for indexing.

Capability set02 / 05

05—08

4 capabilities in this set.

Part of 18 available through Twelve Labs (Video Understanding).

05 Capability
Create asset
Upload a video file to the platform. This creates the base asset for your AI to analyze later.
06 Capability
Create entity
Add a specific person or object to a collection. This allows for granular tracking of specific subjects within your videos.
07 Capability
Create index
Set up a new video index with specific settings. This organizes your footage into searchable categories.
08 Capability
Create multipart upload
Start a session to upload large video files in pieces. This helps keep your uploads stable for big files.

Capability set03 / 05

09—12

4 capabilities in this set.

Part of 18 available through Twelve Labs (Video Understanding).

09 Capability
Delete index
Remove a video index from your account. Use this to clean up old or unnecessary archives.
10 Capability
Get index
Fetch details for a specific video index. Use this to check the status or name of an existing library.
11 Capability
Get indexed asset
Retrieve information about a specific indexed video. This helps your agent find the right file from a large library.
12 Capability
Update index
Change the name of an existing video index. Use this to keep your organized libraries clearly labeled.

Capability set04 / 05

13—15

3 capabilities in this set.

Part of 18 available through Twelve Labs (Video Understanding).

13 Capability
Create entity collection
Group specific objects or people into a custom collection. This helps the AI remember specific recurring subjects.
14 Capability
Embed sync
Create embeddings for a video immediately. Use this for quick, real-time data generation on single clips.
15 Capability
Index asset
Add a newly uploaded video to an existing index. This makes the content searchable by your agent.

Capability set05 / 05

16—18

3 capabilities in this set.

Part of 18 available through Twelve Labs (Video Understanding).

16 Capability
List indexes
See all the video indexes you have created. This helps you navigate your organized video libraries.
17 Capability
Report multipart progress
Check how much of a large video upload has finished. This keeps your agent informed on the status of large files.
18 Capability
Search
Look for specific moments or actions in your videos. This is the primary way your agent finds content using natural language.

Set up in minutes

One URL. Then ask Twelve Labs (Video Understanding) to work.

Claude and ChatGPT only need the Connector URL. Copy it once, add it in settings, and use Twelve Labs (Video Understanding) from the conversation.

Choose your client

Live preview

Advanced clients IDE · CLI

Claude · Web + desktop

Official guide ↗

Connector URL · ready to paste

Streamable HTTP

https://edge.vinkius.com/vk_preview_Vgl5VVTXIogBXlRhR1Xxpl2YsHWFIR0xQ7beKVtS/mcp

Step 01

Open Connectors

In Claude Web or Claude Desktop, open Settings and choose Connectors.
Step 02

Add the URL

Choose Add custom connector, name it Twelve Labs (Video Understanding), and paste the URL above.
Step 03

Turn it on in chat

Select +, open Connectors, and enable Twelve Labs (Video Understanding) for the conversation.

ChatGPT · Web + desktop

Official guide ↗

Connector URL · ready to paste

Streamable HTTP

https://edge.vinkius.com/vk_preview_Vgl5VVTXIogBXlRhR1Xxpl2YsHWFIR0xQ7beKVtS/mcp

Step 01

Open MCP settings

On desktop, open Settings and MCP servers. On web, open your workspace app or connector settings.
Step 02

Add the URL

Choose Add server with Streamable HTTP, or create a custom MCP app, then paste the Twelve Labs (Video Understanding) URL.
Step 03

Save and start

Save the connection and enable Twelve Labs (Video Understanding) in your conversation. Desktop may ask you to restart once.

Cursor · IDE configuration

Official guide ↗

Advanced setup

{
  "mcpServers": {
    "twelve-labs-video-understanding": {
      "url": "https://edge.vinkius.com/vk_preview_Vgl5VVTXIogBXlRhR1Xxpl2YsHWFIR0xQ7beKVtS/mcp"
    }
  }
}

Step 01

Open MCP Settings

Press Cmd+Shift+P (macOS) or Ctrl+Shift+P (Windows/Linux) → search "MCP Settings"
Step 02

Add the server config

Paste the JSON configuration above into the mcp.json file that opens
Step 03

Save the file

Cursor will automatically detect the new Connector
Step 04

Start using Twelve Labs (Video Understanding)

Open Agent mode in chat and ask: "Using Twelve Labs (Video Understanding), help me...". 18 tools available

VS Code Copilot · IDE configuration

Official guide ↗

Advanced setup

{
  "mcpServers": {
    "twelve-labs-video-understanding": {
      "url": "https://edge.vinkius.com/vk_preview_Vgl5VVTXIogBXlRhR1Xxpl2YsHWFIR0xQ7beKVtS/mcp"
    }
  }
}

Step 01

Create MCP config

Create a .vscode/mcp.json file in your project root
Step 02

Add the server config

Paste the JSON configuration above
Step 03

Enable Agent mode

Open GitHub Copilot Chat and switch to Agent mode using the dropdown
Step 04

Start using Twelve Labs (Video Understanding)

Ask Copilot: "Using Twelve Labs (Video Understanding), help me...". 18 tools available

Windsurf · IDE configuration

Official guide ↗

Advanced setup

{
  "mcpServers": {
    "twelve-labs-video-understanding": {
      "url": "https://edge.vinkius.com/vk_preview_Vgl5VVTXIogBXlRhR1Xxpl2YsHWFIR0xQ7beKVtS/mcp"
    }
  }
}

Step 01

Open MCP Settings

Go to Settings → MCP Configuration or press Cmd+Shift+P and search "MCP"
Step 02

Add the server

Paste the JSON configuration above into mcp_config.json
Step 03

Save and reload

Windsurf will detect the new server automatically
Step 04

Start using Twelve Labs (Video Understanding)

Open Cascade and ask: "Using Twelve Labs (Video Understanding), help me...". 18 tools available

Cline · IDE configuration

Official guide ↗

Advanced setup

{
  "mcpServers": {
    "twelve-labs-video-understanding": {
      "url": "https://edge.vinkius.com/vk_preview_Vgl5VVTXIogBXlRhR1Xxpl2YsHWFIR0xQ7beKVtS/mcp"
    }
  }
}

Step 01

Open Cline MCP Settings

Click the Connectors icon in the Cline sidebar panel
Step 02

Add remote server

Click "Add Connector" and paste the configuration above
Step 03

Enable the server

Toggle the server switch to ON
Step 04

Start using Twelve Labs (Video Understanding)

Ask Cline: "Using Twelve Labs (Video Understanding), help me...". 18 tools available

Claude Code · Terminal command

Official guide ↗

Advanced setup

claude mcp add twelve-labs-video-understanding --transport http "https://edge.vinkius.com/vk_preview_Vgl5VVTXIogBXlRhR1Xxpl2YsHWFIR0xQ7beKVtS/mcp"

Step 01

Install Claude Code

Run npm install -g @anthropic-ai/claude-code if not already installed
Step 02

Add the Connector

Run the command above in your terminal
Step 03

Verify the connection

Run claude mcp to list connected servers, or type /mcp inside a session
Step 04

Start using Twelve Labs (Video Understanding)

Ask Claude: "Using Twelve Labs (Video Understanding), show me...". 18 tools are ready

Where the request belongs

Work Twelve Labs can move forward.

Built around the request

This is for media professionals and security operators who are drowning in hours of footage and need a way to find specific moments without watching every second.

01

Video Editor

Finds specific b-roll or scenes across a massive archive to cut highlights faster.

02

Security Analyst

Scans hours of surveillance footage for specific events or objects using plain English.

03

ML Engineer

Generates embeddings and manages entity collections for advanced computer vision projects.

Build the capability set

Each Connector adds new actions and data without changing how you work.

Browse Connectors

01 8 capabilities

ContentGroove

Equip your AI agent to automatically generate video highlights, splice long-form clips, and manage video projects natively with ContentGroove.

02 6 capabilities

Vadoo

Host and optimize video content for the web with AI-powered SEO, automatic subtitles, and engagement analytics for creators.

03 10 capabilities

EX.CO Video Experience

Equip your AI agent to manage video libraries, track interactive content, and monitor analytics via the EX.CO API.

04 11 capabilities

MediaSilo (Legacy)

Share and review video content with creative teams using secure media workspaces, annotations, and approval workflows.

05 9 capabilities

AssemblyAI

Transcribe audio and video files with industry-leading accuracy, detect speakers, and extract insights from spoken content.

06 13 capabilities

Vimeo

Manage your Vimeo video library, search for content, and update video metadata directly from your AI agent.

Bring your own AI

Change the model, client or framework. Keep Twelve Labs connected.

Before you connect

Questions about Twelve Labs.

The practical details behind the request, access and result.

Can I use the Twelve Labs MCP to search my own private videos?

Yes. You can connect your private video library by creating indexes and uploading your files. Once indexed, your AI agent can search through them using natural language.

How does the Twelve Labs MCP handle large video files?

It supports multipart uploads, which allows you to break down and upload large files in pieces. This ensures that your uploads stay stable and complete even for very large assets.

Can the Twelve Labs MCP identify specific people in my footage?

Yes, it can. You can create entity collections to track and identify specific people or objects across your entire video library.

Does the Twelve Labs MCP work with my existing video library?

It works with any video content you can provide via URL or direct upload. You just need to create an index and add your assets to it so the agent can see them.

How do I get structured data out of my videos using the Twelve Labs MCP?

You can use the analysis capabilities to extract structured data from your videos. Your agent can then present this data in tables, summaries, or other formats you need.

Can I use the Twelve Labs MCP to find specific scenes by typing a description?

That is exactly what it is built for. You can type descriptions like "a person running in the park" and the Connector will find the relevant moments for you.

How do I list all my existing video indexes?

You can use the list_indexes capability. It will return a list of all indexes available in your Twelve Labs account, including their IDs and configuration.

Can I search for a specific moment inside my videos using text?

Yes! Use the search capability by providing an index_id and a search query. The AI will find the most relevant timestamps and video segments based on your description.

How do I add a new video to an index for analysis?

First, use create_asset with a public URL to upload the video. Then, use the index_asset capability with the resulting asset_id and your target index_id to start the processing.

One connection away

Give your agent a direct line to Twelve Labs.

Connect Twelve Labs once. Keep it beside 6,100+ managed Connectors when the next task needs more.

Explore every Connector No credit card required · Free tier available