wink-tokenizer Connector for AI agents.
1 live capability
Extract clean entities and words from messy social media text and logs.
Waiting for input…
Why people use wink-tokenizer
Natural Tokenizer Engine for Accurate NLP Entity Extraction
With this Connector, the agent handles the heavy lifting. It identifies every hashtag, email, and emoji instantly using deterministic rules. You get a clean, structured list of parts every time, which means no more manual cleanup of broken strings.
What Vinkius changes
You get predictable, accurate text parsing that does not break your data.
Use it from Claude, ChatGPT, Cursor or another AI client you already have.
One account · 6,100+ Connectors
- Real-world use case 01
Social Media Scraping
A user wants to extract every hashtag and URL from a list of Instagram captions.
- Real-world use case 02
Log File Analysis
An engineer needs to count how many unique emails appear in a messy server log.
- Real-world use case 03
Chatbot Input Cleaning
A developer wants to ensure that when a user types Check this out: https://site.
Complete set · 1capability
The complete wink-tokenizer capability set.
These are the exact actions your AI can choose when you ask it to work with wink-tokenizer.
01
1 capability in this set.
Part of 1 available through wink-tokenizer.
- 01 Capability
Natural tokenizer
Breaks down natural language text into exact words, numbers, emails, URLs, emojis, and hashtags. It ensures punctuation stays separated from words unless it is part of an abbreviation.
Set up in minutes
One URL. Then ask wink-tokenizer to work.
Claude and ChatGPT only need the Connector URL. Copy it once, add it in settings, and use wink-tokenizer from the conversation.
Choose your client
Live previewAdvanced clients IDE · CLI
Claude · Web + desktop
Connector URL · ready to paste
Streamable HTTPhttps://edge.vinkius.com/vk_preview_9uM8ikpa09EQ3HGlCDf8Yimb8DquT4Jkby5DTS0D/mcp - Step 01
Open Connectors
In Claude Web or Claude Desktop, open Settings and choose Connectors.
- Step 02
Add the URL
Choose Add custom connector, name it wink-tokenizer, and paste the URL above.
- Step 03
Turn it on in chat
Select +, open Connectors, and enable wink-tokenizer for the conversation.
ChatGPT · Web + desktop
Connector URL · ready to paste
Streamable HTTPhttps://edge.vinkius.com/vk_preview_9uM8ikpa09EQ3HGlCDf8Yimb8DquT4Jkby5DTS0D/mcp - Step 01
Open MCP settings
On desktop, open Settings and MCP servers. On web, open your workspace app or connector settings.
- Step 02
Add the URL
Choose Add server with Streamable HTTP, or create a custom MCP app, then paste the wink-tokenizer URL.
- Step 03
Save and start
Save the connection and enable wink-tokenizer in your conversation. Desktop may ask you to restart once.
Cursor · IDE configuration
Advanced setup
{
"mcpServers": {
"natural-tokenizer-engine": {
"url": "https://edge.vinkius.com/vk_preview_9uM8ikpa09EQ3HGlCDf8Yimb8DquT4Jkby5DTS0D/mcp"
}
}
} - Step 01
Open MCP Settings
Press Cmd+Shift+P (macOS) or Ctrl+Shift+P (Windows/Linux) → search "MCP Settings"
- Step 02
Add the server config
Paste the JSON configuration above into the mcp.json file that opens
- Step 03
Save the file
Cursor will automatically detect the new Connector
- Step 04
Start using wink-tokenizer
Open Agent mode in chat and ask: "Using wink-tokenizer, help me...". 1 tools available
VS Code Copilot · IDE configuration
Advanced setup
{
"mcpServers": {
"natural-tokenizer-engine": {
"url": "https://edge.vinkius.com/vk_preview_9uM8ikpa09EQ3HGlCDf8Yimb8DquT4Jkby5DTS0D/mcp"
}
}
} - Step 01
Create MCP config
Create a .vscode/mcp.json file in your project root
- Step 02
Add the server config
Paste the JSON configuration above
- Step 03
Enable Agent mode
Open GitHub Copilot Chat and switch to Agent mode using the dropdown
- Step 04
Start using wink-tokenizer
Ask Copilot: "Using wink-tokenizer, help me...". 1 tools available
Windsurf · IDE configuration
Advanced setup
{
"mcpServers": {
"natural-tokenizer-engine": {
"url": "https://edge.vinkius.com/vk_preview_9uM8ikpa09EQ3HGlCDf8Yimb8DquT4Jkby5DTS0D/mcp"
}
}
} - Step 01
Open MCP Settings
Go to Settings → MCP Configuration or press Cmd+Shift+P and search "MCP"
- Step 02
Add the server
Paste the JSON configuration above into mcp_config.json
- Step 03
Save and reload
Windsurf will detect the new server automatically
- Step 04
Start using wink-tokenizer
Open Cascade and ask: "Using wink-tokenizer, help me...". 1 tools available
Cline · IDE configuration
Advanced setup
{
"mcpServers": {
"natural-tokenizer-engine": {
"url": "https://edge.vinkius.com/vk_preview_9uM8ikpa09EQ3HGlCDf8Yimb8DquT4Jkby5DTS0D/mcp"
}
}
} - Step 01
Open Cline MCP Settings
Click the Connectors icon in the Cline sidebar panel
- Step 02
Add remote server
Click "Add Connector" and paste the configuration above
- Step 03
Enable the server
Toggle the server switch to ON
- Step 04
Start using wink-tokenizer
Ask Cline: "Using wink-tokenizer, help me...". 1 tools available
Claude Code · Terminal command
Advanced setup
claude mcp add natural-tokenizer-engine --transport http "https://edge.vinkius.com/vk_preview_9uM8ikpa09EQ3HGlCDf8Yimb8DquT4Jkby5DTS0D/mcp" - Step 01
Install Claude Code
Run npm install -g @anthropic-ai/claude-code if not already installed
- Step 02
Add the Connector
Run the command above in your terminal
- Step 03
Verify the connection
Run claude mcp to list connected servers, or type /mcp inside a session
- Step 04
Start using wink-tokenizer
Ask Claude: "Using wink-tokenizer, show me...". 1 tools are ready
Where the request belongs
Work wink-tokenizer can move forward.
Data engineers cleaning messy social media feeds, NLP researchers building custom pipelines, or developers building chatbots that handle unpredictable user-generated content.
Data Engineer
Cleaning thousands of rows of social media mentions for sentiment analysis without manual cleanup.
NLP Researcher
Building a custom dataset where word boundaries must be 100% accurate for model training.
Chatbot Developer
Ensuring the agent does not break a URL when a user sends a link with a period at the end.
Build the capability set
Add more capabilities.
Each Connector adds new actions and data without changing how you work.
Browse ConnectorsTextRazor
Advanced Natural Language Processing (NLP) to extract entities, topics, and relations from text or URLs.
MonkeyLearn
Analyze text data with custom machine learning models that classify sentiment, extract keywords, and tag topics automatically.
OneAI
Analyze text and media with OneAI Language Skills—summarize, extract entities, and transcribe audio directly through your AI agent.
Regex High-Perf Parser
Stop LLM hallucination when extracting entities. Run pure Regex across massive text blocks and guarantee 100% accurate array extraction.
NLP Cloud
High-performance NLP API for text summarization, entity extraction, classification, sentiment analysis, ASR, and translation.
Bring your own AI
Change the model, client or framework. Keep wink-tokenizer connected.
-
Claude -
ChatGPT -
Gemini -
Cursor -
VS Code -
Windsurf -
ZCode -
Cline -
Zed -
Continue -
Kiro -
Roo Code -
Zencoder -
Goose -
Void -
Augment Code -
Amp -
Qodo -
Tabnine -
Pieces -
Sourcegraph Cody -
JetBrains -
Warp -
Amazon Q -
Antigravity -
BoltAI -
Raycast -
Jan -
LM Studio -
AnythingLLM -
Open WebUI -
Msty -
Cherry Studio -
LibreChat -
TypingMind -
Chorus -
5ire -
n8n -
LangChain -
LlamaIndex -
CrewAI -
Vercel AI SDK
Before you connect
Questions about wink-tokenizer.
The practical details behind the request, access and result.
What does the Natural Tokenizer Engine do for my text?
It breaks down messy sentences into clean pieces like words, numbers, emails, and links. This prevents your AI from getting confused by punctuation or merging different types of data together.
Can the Natural Tokenizer Engine handle social media posts?
Yes, it is specifically built to handle mixed content. It keeps hashtags, mentions, and emojis intact while separating them from the surrounding text.
Will it break my URLs?
No, the Natural Tokenizer Engine is designed to keep web links together. It knows not to split a URL just because it ends with a period or other punctuation marks.
How does this help my AI agent?
It gives your agent eyes for structure. Instead of guessing where a word ends, the agent gets a definitive list of entities, which makes it much better at data extraction and analysis.
Does the Natural Tokenizer Engine support emojis?
Yes, it identifies emojis as distinct tokens. This is helpful if you want to count them or analyze them without them being lumped in with the surrounding words.
Is this better than just asking the AI to extract data?
Yes, because standard AI models often hallucinate boundaries in complex strings. This Connector uses deterministic rules to ensure the results are consistent every single time.
Why not just use regular expressions (regex)?
Regex is brittle. A regex for URLs might break if it ends with a period, or fail to handle complex unicode emojis. This engine uses a robust, battle-tested state machine designed specifically for natural language parsing.
How does it handle abbreviations vs end-of-sentence periods?
It's smart enough to know that 'Ph.D.' is a single word token, but 'world.' is the word 'world' followed by a punctuation token '.'. This is crucial for accurate sentence boundary detection.
Can it extract all emails from a large block of text?
Yes. Pass the text and filter the resulting tokens where tag === 'email'. You'll get an exact array of every email address found, completely separated from surrounding text.
One connection away
Give your agent a direct line to wink-tokenizer.
Connect wink-tokenizer once. Keep it beside 6,100+ managed Connectors when the next task needs more.
Explore every Connector No credit card required · Free tier available