What is ExaSearchBot?
Exa · Search indexes · User agent only
ExaSearchBot is Exa's AI search crawler. Crawls and indexes public pages for Exa, a search engine whose API serves results to AI apps and agents.
A visit usually means: The page is being discovered or refreshed so it can appear in search or AI search results.
ExaSearchBot user agent
The full user agent string, as Exa publishes it:
- User-Agent
Mozilla/5.0 (compatible; ExaSearchBot/1.0; +https://crawler.exa.ai/)
Version numbers change, so match the token ExaSearchBot anywhere in the user agent, ignoring case. Source: Exa's crawler documentation, checked Nov 18, 2026.
Reading the string
- The published version is ExaSearchBot/1.0. Expect the number to change.
- It starts with Mozilla/5.0, like a browser, so a filter that only checks the start of the string will miss it.
- It carries a link, https://crawler.exa.ai/, so anyone reading their logs can look the crawler up.
Paste a string from your logs into the user agent parser to see which crawler it is. New to the term? Read what a user agent is.
Block or allow ExaSearchBot in robots.txt
Exa says ExaSearchBot follows robots.txt. Without a group naming ExaSearchBot, it follows the rules set for major search engines, and otherwise the * group.
User-agent: ExaSearchBot
Disallow: /User-agent: ExaSearchBot
Disallow: /private/User-agent: ExaSearchBot
Allow: /A crawler follows the most specific group that names it, so a rule here overrides your User-agent: * group for this crawler. Well-behaved crawlers re-read robots.txt within about a day.
ExaSearchBot and Exa's other crawlers
Exa runs 2 crawlers in this directory, each with its own robots.txt token and its own job. What blocking each one costs you:
- ExaSearchBot · IndexingYour pages in Exa's AI search answers
- ExaUser · AnswersExa's assistant reading your pages when someone asks about them
ExaSearchBot IP ranges and verification
Exa publishes no IP ranges for ExaSearchBot, so requests are identified by user agent only and recorded as unverified. Anyone can send this user agent.
Signed requests (Web Bot Auth)
Exa also signs ExaSearchBot's requests and publishes the keys at https://crawler.exa.ai. MetricRaven records a request with a valid signature from that key directory as verified.
What ExaSearchBot means for your traffic and revenue
ExaSearchBot builds the index Exa draws on for AI search answers. Blocking it can keep your pages out of those answers and the clicks they send.
Most crawlers never run JavaScript, so browser analytics can't see them, and the ones that do shouldn't count as visitors. MetricRaven's tracker ignores ExaSearchBot, and server-side crawl tracking shows which pages it reads instead. See Bots & AI crawlers.
Questions
- What is ExaSearchBot?
- Crawls and indexes public pages for Exa, a search engine whose API serves results to AI apps and agents. MetricRaven groups it under Search indexes: search engines and AI search keeping their index fresh.
- What is the ExaSearchBot user agent?
- Exa documents this user agent: "Mozilla/5.0 (compatible; ExaSearchBot/1.0; +https://crawler.exa.ai/)". Match the token "ExaSearchBot" rather than the whole string, because version numbers change.
- How do I block ExaSearchBot in robots.txt?
- Add "User-agent: ExaSearchBot" followed by "Disallow: /" to your robots.txt. Exa says ExaSearchBot follows robots.txt. Without a group naming ExaSearchBot, it follows the rules set for major search engines, and otherwise the * group.
- Does ExaSearchBot publish IP ranges?
- No. Exa publishes no IP ranges for ExaSearchBot, so only the user agent identifies it, and anyone can send that string.
- Is ExaSearchBot safe?
- The real ExaSearchBot only requests public pages, and Exa documents it. The risk is impostors using its name. Whether to allow it depends on what you get back: the page is being discovered or refreshed so it can appear in search or AI search results.
- What other crawlers does Exa run?
- ExaUser (AI assistant). Each has its own robots.txt token, and each does a different job.
See when AI assistants and crawlers read your site
Add one line to your server and MetricRaven shows which assistants, search engines and training crawlers request your pages, which ones are IP-verified, and the URLs they expected to find, including 404s.