An astronaut overseeing a futuristic data hub
Download PDFMarkdown Version

Connect MinHash Text Deduplicator to ChatGPT and Claude

Set it up once and it works in ChatGPT, Claude, Cursor, and any other client you love. It all runs safely in the background, so you can relax and focus on what really matters. Clean up redundant text and find near-duplicate content.

Ask AI about this Connector

Developed, maintained, and hosted by Vinkius.

MCP VERIFIED · PRODUCTION READY · VINKIUS GUARANTEED

Waiting for input…

Works with modern AI clients that support MCP, including ChatGPT, Claude, Cursor, and more.

ChatGPTClaudeCursorPerplexityGeminiMicrosoft CopilotRaycastMeta AI

Your AI does the work. We keep it safe and sound.

No other AI tool gives you this. Your workflow runs in the client you already love, your account stays protected, and you decide what the agent can and cannot do. It is the whole reason to make the switch.

Each Connector lives inside our infrastructure, the same place where your workflow runs. The three things below are already part of it, working quietly in the background so you never have to think about them. Nothing to add, nothing to set up, nothing to worry about.

A futuristic MCP client docking bay
V8 Isolate01

Each Connector runs inside its own sealed environment.

Each Connector runs inside its own sealed V8 runtime — no access to your files, your system, or other servers. A Connector never sees past its own request.

Kill Switch02

One switch stops every agent. Instantly.

One action deactivates every Connector, revokes every token, and ends every session at once. AI Governance keeps the record.

FinOps per User03

Spending limits that pause instead of surprise.

Every user keeps their own connections and credentials, isolated from everyone else. Anything that would cross your spending limit is held for your approval, not billed.

Three controls, built into the layer your AI connects through.

Curated set · 3 capabilities

We ship only the actions that matter.

Capability set01 / 01

01-03

3 capabilities in this set.

Part of 3 available through MinHash Text Deduplicator.

  1. 01

    Check is duplicate

    This capability performs a binary check to see if a specific piece of text is a near-duplicate of anything already in your collection.

  2. 02

    Compute similarity matrix

    This capability calculates the estimated Jaccard similarity between every text entry you provide to show how they relate.

  3. 03

    Identify duplicate clusters

    This capability groups your texts into distinct sets of near-duplicates based on a similarity threshold you set.

Real work

What teams actually run

01

Web Scraping Cleanup

Remove nearly identical pages from a large crawl to keep your database clean.

02

Dataset Auditing

Check a new batch of text against an existing library to prevent redundancy.

03

Plagiarism Detection

Identify when different documents share significant portions of the same content.

04

Document Clustering

Organize a massive collection of files into groups of similar topics or structures.

One connector, every AI

MinHash Text Deduplicator works with the most popular AI clients.

These are the most popular clients, each with a step-by-step guide: one link, set up once, with governance and visibility built in. And because everything runs on the MCP standard, the same connection also works in any other compatible client — nothing to rebuild.

ClaudeClaudeChatGPTChatGPTGeminiGeminiPerplexityPerplexityGrokGrokMicrosoft CopilotMicrosoft CopilotCursorCursorVS CodeVS CodeWindsurfWindsurfJetBrainsJetBrainsClineClineLangChainLangChainVercel AI SDKVercel AI SDKLovableLovableZ.aiZ.aiRaycastRaycastQwen CodeQwen CodeKimi CodeKimi CodeLe ChatLe Chat

Building your own app? The connector is yours to use.

You don't need a client to put MinHash Text Deduplicator to work: the same hosted connection plugs into your own applications and agent code, with the same governance on every request. Build with it, chat with it — one connection for both.

Observed, not estimated

901ms average. Fast in production.

MinHash Text Deduplicator is checked daily against the live service.

Daily averagePeak 1071ms
Oct 3Today
Fastest day
699ms
Slowest day
1071ms
14-day trend
Stable+4%

Connect your client

One URL. Every client.

Activate the Connector, copy your link, and paste it into the client you already use. 3 capabilities arrive ready to run.

Preview access · not provider authentication

The vk_preview_* token belongs to Vinkius preview infrastructure. It lets Claude discover and display the capabilities of MinHash Text Deduplicator, so you can see the experience inside your AI.

It does not authenticate your account with MinHash Text Deduplicator. Actions requiring credentials or live account data may not run until you activate the Connector and authorize the service.

MinHash Text Deduplicator Connector

You're all set. Choose your MCP client and follow the setup instructions.

Connector linkhttps://edge.vinkius.com/vk_preview_Hrwd2eQSW1CKLVQMLfqo9vh7UJ78eowNZ6AnF9OF/mcp

Claude Desktop

Follow the steps below to connect in seconds.

  1. 1In Claude Desktop, open Settings → Connectors.
  2. 2Click “Add custom connector” and paste the connector link above as the remote MCP server URL.
  3. 3Click Add and start a new chat — MinHash Text Deduplicator capabilities are ready to use.
Configuration · claude_desktop_config.jsonCopy
{
  "mcpServers": {
    "minhash-text-deduplicator-mcp": {
      "url": "https://edge.vinkius.com/vk_preview_Hrwd2eQSW1CKLVQMLfqo9vh7UJ78eowNZ6AnF9OF/mcp"
    }
  }
}
  • Claude
  • ChatGPT
  • Cursor
  • VS Code
  • Windsurf
  • Claude Code
  • JetBrains
  • Cline

Step-by-step instructions for each client are in the guide. How to connect

Guided setup for Claude? Set up MinHash Text Deduplicator in Claude and other AIs

See all the AI clients this connector works with ↑

Who it's for

Built for the work MinHash Text Deduplicator owners hand off.

This MCP is built for professionals managing large volumes of unstructured text data who need to maintain high data quality.

  • 01

    Data Engineers

    They use it to clean up scraped datasets or deduplicate logs.

  • 02

    Machine Learning Researchers

    They use it to ensure training datasets do not contain redundant samples.

  • 03

    Content Analysts

    They use it to identify repetitive content across large document repositories.

FAQ

Questions MinHash Text Deduplicator owners ask.

  • 01

    How does this MCP find duplicates?

    It uses shingling and MinHash signatures to estimate Jaccard similarity between text entries.

  • 02

    Can I use this with Claude or Cursor?

    Yes, it works with any MCP-compatible client including Claude, Cursor, and Windsurf.

  • 03

    What is the difference between exact and near-duplicate detection?

    Exact detection looks for identical characters, while this MCP finds texts that are structurally similar using mathematical signatures.

  • 04

    Do I need to host the MCP myself?

    No, Vinkius hosts and manages the MCP for you, so it is ready to use once you connect.

  • 05

    How do I group similar texts together?

    You can use the identify_duplicate_clusters capability to group texts into sets based on a similarity threshold.

  • 06

    How does the similarity estimation work?

    It uses MinHash signatures to estimate the Jaccard similarity between sets of shingles, providing a score between 0.0 and 1.0.

  • 07

    What is the purpose of the ngramSize parameter?

    The ngramSize determines the length of the shingles. A larger size requires more exact sequence matches to trigger a duplicate detection.

  • 08

    Can I use this to clean up my vector database?

    Yes, you can use identify_duplicate_clusters to find redundant entries and remove them to prevent bloat in your vector stores.

Explore

More in Data Analysis

Suggestions

Connect MinHash Text Deduplicator to Claude, Cursor, ChatGPT & more