- SYNC
- INDEX
- QUERY
- REVIEW
Short answer
How do I add website content to my AI's knowledge?
Give your AI a URL and ask it to ingest the page. It uses Aidbase to scrape the site and add the text to your existing knowledge base. You'll get an agent that knows the latest documentation.
The outcomes
What your knowledge base gains.
Adding new URLs changes how your agent responds to your questions.
SYNC
Live web data
The AI pulls text from the URL you provide. This content becomes part of your searchable knowledge base immediately.
INDEX
Organized info
The AI processes the scraped data so it's ready for retrieval. You don't have to clean up the text yourself.
QUERY
Better answers
Your AI uses the new data to answer questions. It pulls from the specific documentation you just added.
REVIEW
Human control
You decide which URLs are worth adding. The AI only ingests what you explicitly tell it to scrape.
The workflow
What your AI does when a URL is provided.
The AI handles the scraping and storage of the web content.
Scrape the site
The AI visits the URL you provided to extract the relevant text.
add_aidbase_website_knowledgeUpdate the base
The extracted information is added to your Aidbase repository.
add_aidbase_website_knowledgeCheck existing data
The AI looks at what is already in your knowledge base.
list_aidbase_knowledgeConfirm status
The AI verifies the new content is indexed and ready to use.
list_aidbase_knowledge
Try it
Copy these to start.
Use these prompts to trigger the ingestion process.
Starting points
Swap the example URLs for the actual documentation links you want to add.
Aidbase Connector
You're all set. Choose your MCP client and follow the setup instructions.
https://edge.vinkius.com/vk_preview_K8VJgZLNAsUABAHWsTYx3rO7iFrPYSGDVs8iWJ5N/mcpClaude Desktop
Follow the steps below to connect in seconds.
- 1In Claude Desktop, open Settings → Connectors.
- 2Click “Add custom connector” and paste the connector link above as the remote MCP server URL.
- 3Click Add and start a new chat — Aidbase capabilities are ready to use.
{
"mcpServers": {
"aidbase-mcp": {
"url": "https://edge.vinkius.com/vk_preview_K8VJgZLNAsUABAHWsTYx3rO7iFrPYSGDVs8iWJ5N/mcp"
}
}
}Add the documentation from https://docs.example.com to my knowledge base.
Read this website and add it to my Aidbase: https://help.service.com
Update my knowledge base using the content from this URL: https://manual.app/v1
Can you ingest the text from https://wiki.internal.io into my knowledge base?
Claude
ChatGPT
Cursor
VS Code
Windsurf
Claude Code
JetBrains
Cline
Start here
Connect Aidbase once, then ask.
Click the link to connect your account. Your credentials stay encrypted on our side, and you can find the full walkthrough on the Connector page.
Connect Aidbase to your AIFAQ
How this task behaves
- 01
Can the AI delete existing knowledge?
No. This tool only adds new information to your knowledge base.
- 02
Does the AI scrape the entire internet?
No. It only reads the specific URL you provide in your prompt.
- 03
Will the AI automatically update when a website changes?
No. You must manually ask the AI to re-ingest a URL to capture updates.
- 04
Can I see what is currently in my knowledge base?
Yes. Your AI can list your existing knowledge entries to show you what it knows.
- 05
Can the AI edit the text it scrapes?
No. The AI only ingests the text as it exists on the page.
More questions about Aidbase? The Connector page answers them. See everything the Aidbase Connector can do
Connect Aidbase to Claude, Cursor, ChatGPT & more
