• DATA
  • TEXT
  • LOGIC
  • HUMAN

How to run vision inference with your AI

Connect the NVIDIA API Catalog to your client to give your agent eyes. Once connected, you can pass images or graphical data directly to your AI for analysis.

Ask AI about this page

Short answer

How can I use vision inference in my AI chat?

You provide an image or a graphical input to your AI client, which then uses the NVIDIA API Catalog to process the pixels. The AI extracts the specific diagnostic data or visual patterns you asked for. You'll see the results as text or structured data in your chat window.

Visual data outcomes

What your AI finds

The results of your visual queries.

DATA

Extracted diagnostics

The AI pulls specific measurements or status indicators from a visual input. You get raw data points ready for your reports.

TEXT

Visual descriptions

The AI translates what it sees into plain text. This turns images into searchable or readable descriptions.

LOGIC

Pattern recognition

The AI identifies specific objects or anomalies within a frame. It flags things that match your criteria.

HUMAN

Manual review

The AI flags uncertain findings for you. You decide if the visual inference is accurate enough to act on.

The workflow

What your AI does when an image arrives.

The AI handles the heavy lifting of pixel processing so you don't have to.

  1. Receive input

    Your AI client receives the image or the graphical file you uploaded to the chat.

    nvidia_vision_inference

  2. Process pixels

    The agent sends the visual data to the NVIDIA API to run inference models.

    nvidia_vision_inference

  3. Extract data

    The model identifies the specific diagnostic details or objects requested in your prompt.

    nvidia_vision_inference

  4. Deliver results

    The AI presents the findings as text, numbers, or structured data in your conversation.

    nvidia_vision_inference

Try it

Copy these to start.

Use these prompts once you've connected the MCP.

Starting points

Replace the bracketed text with your specific image or data type.

NVIDIA API Catalog Connector

You're all set. Choose your MCP client and follow the setup instructions.

Connector linkhttps://edge.vinkius.com/vk_preview_LgfbZayzkE3ZBfq9HWv3rgeK69AXP0h3anUpakUy/mcp

Claude Desktop

Follow the steps below to connect in seconds.

  1. 1In Claude Desktop, open Settings → Connectors.
  2. 2Click “Add custom connector” and paste the connector link above as the remote MCP server URL.
  3. 3Click Add and start a new chat — NVIDIA API Catalog capabilities are ready to use.
Configuration · claude_desktop_config.jsonCopy
{
  "mcpServers": {
    "nvidia-api-catalog-mcp": {
      "url": "https://edge.vinkius.com/vk_preview_LgfbZayzkE3ZBfq9HWv3rgeK69AXP0h3anUpakUy/mcp"
    }
  }
}
Copy into chat04

  • Analyze this screenshot and list the error codes visible in the dashboard.

  • Look at this image of the component and tell me if there are any visible cracks.

  • Extract the text and data from this graph and summarize the trend.

  • Identify all the warning icons in this system status image.

  • Claude
  • ChatGPT
  • Cursor
  • VS Code
  • Windsurf
  • Claude Code
  • JetBrains
  • Cline

Start here

Connect NVIDIA API Catalog once, then ask.

One click connects this MCP to your client. Your credentials stay encrypted and secure on our end.

Connect NVIDIA API Catalog to your AI

FAQ

How the vision task behaves

  • 01

    Can the AI edit the images it analyzes?

    No. The AI can only read and interpret the visual data provided.

  • 02

    Does the AI automatically save these images to my drive?

    No. The AI only processes the images you explicitly provide in the chat.

  • 03

    Can I use this for real-time video feeds?

    No. This tool is designed for processing specific graphical inputs and images provided during a session.

  • 04

    Will the AI make final decisions on diagnostic data?

    No. The AI provides the inference and data extraction, but you must review the results before taking action.

  • 05

    What kind of files can I use?

    The AI processes standard graphical inputs and image files that your client can upload.

  • More questions about NVIDIA API Catalog? The Connector page answers them. See everything the NVIDIA API Catalog Connector can do

Connect NVIDIA API Catalog to Claude, Cursor, ChatGPT & more