• COORDINATES
  • LABELS
  • LOGS
  • HUMAN

How to extract object metadata from video with your AI

Connect EyePop.ai to your agent to turn video footage into usable data. Once connected, your AI handles the heavy lifting of visual analysis.

Ask AI about this page

Short answer

How can I get object data from video using AI?

Your AI agent uses the analyze_video tool to scan footage and produce structured outputs like bounding boxes and class IDs. You'll get organized data ready for your database or downstream tasks.

Data outputs you'll receive.

Where the data lands.

The analysis results land in these formats.

COORDINATES

Bounding box data

The AI identifies exactly where objects appear in the frame. You get precise spatial coordinates for every detected item.

LABELS

Classification IDs

Every detected object gets a specific ID. This turns visual pixels into searchable text labels.

LOGS

Structured JSON

The tool outputs everything in a clean format. You can pipe this directly into your own scripts or spreadsheets.

HUMAN

Manual review

You decide which detections are accurate. The AI provides the data, but you maintain final control over the truth.

The workflow

What your AI does when the video arrives.

The AI handles the visual processing so you don't have to manually watch footage.

  1. Video ingestion

    Your agent accesses the raw video file you provide. It prepares the frames for deep inspection.

    analyze_video

  2. Visual scanning

    The AI scans the footage to find specific objects or patterns. It looks for movement and shape signatures.

    analyze_video

  3. Metadata generation

    The agent converts visual findings into structured data. It maps out the bounding boxes and assigns IDs.

    analyze_video

  4. Data delivery

    The final structured output is handed back to your chat interface. You can then ask questions about the results.

    analyze_video

Try it

Copy these to start.

Use these prompts to trigger the analysis immediately.

Starting points

These are basic openers. Swap out the bracketed text with your specific file names or object types.

EyePop.ai Connector

You're all set. Choose your MCP client and follow the setup instructions.

Connector linkhttps://edge.vinkius.com/vk_preview_cGrHSw5koZ6157myj6LuxsjlFf5P2wK2JZdQoPtm/mcp

Claude Desktop

Follow the steps below to connect in seconds.

  1. 1In Claude Desktop, open Settings → Connectors.
  2. 2Click “Add custom connector” and paste the connector link above as the remote MCP server URL.
  3. 3Click Add and start a new chat — EyePop.ai capabilities are ready to use.
Configuration · claude_desktop_config.jsonCopy
{
  "mcpServers": {
    "eyepopai-mcp": {
      "url": "https://edge.vinkius.com/vk_preview_cGrHSw5koZ6157myj6LuxsjlFf5P2wK2JZdQoPtm/mcp"
    }
  }
}
Copy into chat04

  • Analyze this video [filename.mp4] and give me the bounding boxes for all cars.

  • Extract the classification IDs for every person detected in [video_clip.mov].

  • Run an analysis on [footage.mp4] and list all detected objects in a table.

  • Find all instances of [object_name] in [video_file.mp4] and provide the coordinates.

  • Claude
  • ChatGPT
  • Cursor
  • VS Code
  • Windsurf
  • Claude Code
  • JetBrains
  • Cline

Start here

Connect EyePop.ai once, then ask.

Just click the link to connect. Your credentials stay encrypted, and you can start prompting your agent right away.

Connect EyePop.ai to your AI

FAQ

How this task behaves.

  • 01

    Can the AI edit the video file?

    No. The AI only reads the video to extract data; it cannot modify or re-encode the original file.

  • 02

    Does the AI delete my footage?

    No. The AI only accesses the files you explicitly point it toward for analysis.

  • 03

    What kind of video formats work?

    The tool supports standard video formats like MP4 and MOV.

  • 04

    Can I ask for specific object types?

    Yes. You can tell your agent to look for specific things like 'pedestrians' or 'vehicles' during the analysis.

  • 05

    Who decides if a detection is correct?

    You do. The AI provides the data, but you are responsible for verifying the accuracy of the bounding boxes and IDs.

  • More questions about EyePop.ai? The Connector page answers them. See everything the EyePop.ai Connector can do

Connect EyePop.ai to Claude, Cursor, ChatGPT & more