• TASK CREATION
  • VIDEO OUTPUT
  • HUMAN REVIEW
  • ITERATION

How to generate video clips with your AI

Connect Runway ML to your agent to turn text prompts into video. Once connected, you just describe what you want to see.

Ask AI about this page

Short answer

How can I make videos using my AI agent?

You describe a scene in plain text to your AI, and it uses the Runway ML connector to start a generation task. This moves your idea from a chat window into a video file. You'll see how the handoff works below.

The outcomes

What your prompts produce

The AI handles the technical handoff to Runway.

TASK CREATION

Generation starts

The AI uses create_task to send your scene description to Runway. This kicks off the actual video rendering process.

VIDEO OUTPUT

Visual results

Runway processes the prompt and generates a video clip based on the Gen-2 or Gen-3 models. You get a finished clip ready for use.

HUMAN REVIEW

Manual refinement

You need to look at the output to decide if the motion or style matches your vision. If it doesn't, you'll need to tweak your prompt.

ITERATION

Prompt tweaking

You can ask your AI to change specific details of the scene. It will trigger a new task with the updated description.

The workflow

What your AI does when the prompt arrives.

The AI acts as the bridge between your conversation and the video engine.

  1. Interpret scene

    Your agent reads your description and identifies the visual elements needed for a video.

    create_task

  2. Trigger Runway

    The agent sends the formatted prompt to Runway to begin the generation.

    create_task

  3. Monitor status

    The AI tracks the task to see when the video is ready for you to view.

    create_task

  4. Deliver clip

    Once the video is finished, the AI provides the result back in your chat interface.

    create_task

Try it

Copy these to start.

Use these lines to kick off your first generation.

Starting points

These are basic ideas. Swap out the subjects and settings to get different results.

Runway ML Connector

You're all set. Choose your MCP client and follow the setup instructions.

Connector linkhttps://edge.vinkius.com/vk_preview_FzKS58CS7GrKP3SzLX2e7AIMNzTDbvY8eQtVxSEb/mcp

Claude Desktop

Follow the steps below to connect in seconds.

  1. 1In Claude Desktop, open Settings → Connectors.
  2. 2Click “Add custom connector” and paste the connector link above as the remote MCP server URL.
  3. 3Click Add and start a new chat — Runway ML capabilities are ready to use.
Configuration · claude_desktop_config.jsonCopy
{
  "mcpServers": {
    "runway-ml-alternative-mcp": {
      "url": "https://edge.vinkius.com/vk_preview_FzKS58CS7GrKP3SzLX2e7AIMNzTDbvY8eQtVxSEb/mcp"
    }
  }
}
Copy into chat04

  • Generate a video of a neon cyberpunk city in the rain using Runway.

  • Create a cinematic clip of a golden retriever running through a field of sunflowers.

  • Use Runway to make a slow-motion video of coffee pouring into a glass.

  • Make a video of a futuristic spaceship landing on a desert planet.

  • Claude
  • ChatGPT
  • Cursor
  • VS Code
  • Windsurf
  • Claude Code
  • JetBrains
  • Cline

Start here

Connect Runway ML once, then ask.

Just click to connect your account. Your credentials stay encrypted, and you can start prompting immediately.

Connect Runway ML to your AI

FAQ

How this task behaves

  • 01

    Can the AI edit existing videos?

    No. This connector is specifically for generating new clips from text descriptions.

  • 02

    Does the AI choose the model?

    The AI uses the models available through the Runway connection, typically Gen-2 or Gen-3, based on your description.

  • 03

    Will the AI delete my Runway account?

    No. The AI only has permission to create tasks. It cannot manage your account settings or delete files.

  • 04

    Can I control the video length?

    You can try to specify length in your text prompt, but the final duration depends on the Runway model being used.

  • 05

    Do I need to open the Runway website?

    No. Once you connect, you can trigger everything directly from your AI client.

  • More questions about Runway ML? The Connector page answers them. See everything the Runway ML Connector can do

Connect Runway ML to Claude, Cursor, ChatGPT & more