• RANKING
  • FILTERS
  • UX
  • HUMAN

How to test search relevancy with your AI

Connect Klevu to your AI client to run automated search audits. You can validate ranking logic and filter behavior instantly.

Ask AI about this page

Short answer

How can I test my search relevancy without manual testing?

Your AI uses Klevu's search tools to simulate real user queries and filter selections. It checks how products rank for specific terms and confirms if filters return the expected results. You get a clear view of your search engine's performance through direct queries.

The testing outcomes.

Where your insights land.

These are the specific results your AI generates from the search data.

RANKING

Keyword relevance checks

The AI runs specific terms to see which products appear first. You'll see if your most important products are actually surfacing for high-intent keywords.

FILTERS

Filter logic validation

The agent tests how product attributes affect the result set. This confirms that your facets and categories are working as intended.

UX

Autocomplete accuracy

The AI checks the suggestions provided during typing. This helps you ensure users find what they need before they even finish their query.

HUMAN

Manual adjustments

The AI identifies gaps in relevancy, but you must decide on the actual merchandising changes. It flags the issues, but you own the final ranking logic.

The workflow

What your AI does when <the thing arrives>.

The AI acts as a virtual QA tester for your e-commerce storefront.

  1. Simulate user queries

    The agent sends specific search terms to your Klevu instance to see what products come up.

    search_keyword

  2. Verify filter accuracy

    The AI applies specific attributes to a search to ensure the results match the selected criteria.

    search_filtered

  3. Test predictive text

    The agent checks the suggestions that appear as a user types to ensure they are relevant.

    search_autocomplete

  4. Audit raw data

    The AI pulls the full response data to inspect the underlying product metadata and ranking scores.

    search_raw

Try it

Copy these to start.

Use these prompts to begin your relevancy testing.

Starting points

Replace the bracketed text with your actual search terms or product categories.

Klevu Connector

You're all set. Choose your MCP client and follow the setup instructions.

Connector linkhttps://edge.vinkius.com/vk_preview_upWpYwqu7xFl2Y0MdSXFTqA1KcNBDKyb7teJnJ7k/mcp

Claude Desktop

Follow the steps below to connect in seconds.

  1. 1In Claude Desktop, open Settings → Connectors.
  2. 2Click “Add custom connector” and paste the connector link above as the remote MCP server URL.
  3. 3Click Add and start a new chat — Klevu capabilities are ready to use.
Configuration · claude_desktop_config.jsonCopy
{
  "mcpServers": {
    "klevu-e-commerce-ai-search-mcp": {
      "url": "https://edge.vinkius.com/vk_preview_upWpYwqu7xFl2Y0MdSXFTqA1KcNBDKyb7teJnJ7k/mcp"
    }
  }
}
Copy into chat04

  • Run a search for [keyword] and tell me which products are in the top 5.

  • Test the [category] filter with the [attribute] applied and check if any irrelevant products show up.

  • Check the autocomplete suggestions for the term '[keyword]' and tell me if they match our top sellers.

  • Pull the raw search results for '[keyword]' and summarize the product attributes for the first three items.

  • Claude
  • ChatGPT
  • Cursor
  • VS Code
  • Windsurf
  • Claude Code
  • JetBrains
  • Cline

Start here

Connect Klevu once, then ask.

Just link your Klevu account through the Vinkius dashboard. Your credentials stay encrypted, and you can start testing immediately in your preferred AI client.

Connect Klevu to your AI

FAQ

How the testing behaves.

  • 01

    Can the AI change my product rankings?

    No. The AI can only read and test the existing results. You have to make any changes within the Klevu dashboard yourself.

  • 02

    Does the AI test real customer sessions?

    No. The AI simulates searches using the tools provided. It doesn't watch live users on your site.

  • 03

    Can I test how filters work together?

    Yes. You can ask the AI to apply multiple filters in a single query to see how the results narrow down.

  • 04

    Will the AI delete any products or data?

    No. The tools provided are read-only. The AI cannot modify, delete, or add products to your catalog.

  • 05

    How does the AI know if a result is relevant?

    The AI uses the product metadata and the ranking data returned by the search tools to evaluate the results against your instructions.

  • More questions about Klevu? The Connector page answers them. See everything the Klevu Connector can do

Connect Klevu to Claude, Cursor, ChatGPT & more