MetricRaven

What is SofyaBot?

Sofya · Search indexes · User agent + IP range

SofyaBot is Sofya's search engine crawler. Builds Sofya's own independent search index, served at search.sofya.co.

A visit usually means: The page is being discovered or refreshed so it can appear in search or AI search results.

SofyaBot user agent

The full user agent string, as Sofya publishes it:

  • User-Agent
    SofyaBot/1.0 (+https://sofya.co/bot)

Version numbers change, so match the token SofyaBot anywhere in the user agent, ignoring case. Source: Sofya's crawler documentation, checked Nov 18, 2026.

Reading the string

  • The published version is SofyaBot/1.0. Expect the number to change.
  • It has no browser parts (no Mozilla/5.0 prefix), so it's easy to tell apart from visitors.
  • It carries a link, https://sofya.co/bot, so anyone reading their logs can look the crawler up.

Paste a string from your logs into the user agent parser to see which crawler it is. New to the term? Read what a user agent is.

Block or allow SofyaBot in robots.txt

Sofya says SofyaBot follows robots.txt.

Block everywhere
robots.txt
User-agent: SofyaBot
Disallow: /
Keep out of a folder
robots.txt
User-agent: SofyaBot
Disallow: /private/
Allow
robots.txt
User-agent: SofyaBot
Allow: /

A crawler follows the most specific group that names it, so a rule here overrides your User-agent: * group for this crawler. Well-behaved crawlers re-read robots.txt within about a day.

SofyaBot and Sofya's other crawlers

Sofya runs 2 crawlers in this directory, each with its own robots.txt token and its own job. What blocking each one costs you:

  • SofyaBot · IndexingYour pages in Sofya's search results
  • Sofya-User · AnswersSofya's assistant reading your pages when someone asks about them

SofyaBot IP ranges and verification

Verified when the user agent and the IP range both match

  1. 1User agent

    The request's user agent contains SofyaBot.

  2. 2Request IP

    Your server-side tracker sends the IP that made the request.

  3. 3Range check

    The IP is compared with the ranges Sofya publishes, refreshed twice a day.

Range sources

Check by reverse DNS

Sofya documents a DNS check you can run on any IP in your logs: a reverse DNS lookup of the request's IP should return a hostname ending in sofya.co, and a forward lookup of that hostname should return the same IP.

terminal
host <ip>          # → a name ending in sofya.co
host <that name>   # → the same <ip>

What SofyaBot means for your traffic and revenue

SofyaBot decides whether your pages can appear in Sofya's search results. Blocking it takes you out of them, along with the visitors and sales that search sends.

Most crawlers never run JavaScript, so browser analytics can't see them, and the ones that do shouldn't count as visitors. MetricRaven's tracker ignores SofyaBot, and server-side crawl tracking shows which pages it reads instead. See Bots & AI crawlers.

Questions

What is SofyaBot?
Builds Sofya's own independent search index, served at search.sofya.co. MetricRaven groups it under Search indexes: search engines and AI search keeping their index fresh.
What is the SofyaBot user agent?
Sofya documents this user agent: "SofyaBot/1.0 (+https://sofya.co/bot)". Match the token "SofyaBot" rather than the whole string, because version numbers change.
How do I block SofyaBot in robots.txt?
Add "User-agent: SofyaBot" followed by "Disallow: /" to your robots.txt. Sofya says SofyaBot follows robots.txt.
Does SofyaBot publish IP ranges?
Yes. Sofya publishes the addresses it sends SofyaBot from: https://sofya.co/bot/ips.json. A request that claims to be SofyaBot from any other IP is an impostor. You can also check DNS: a reverse DNS lookup of the request's IP should return a hostname ending in sofya.co, and a forward lookup of that hostname should return the same IP.
Is SofyaBot safe?
The real SofyaBot only requests public pages, and Sofya documents it. The risk is impostors using its name, which the published IP ranges catch. Whether to allow it depends on what you get back: the page is being discovered or refreshed so it can appear in search or AI search results.
What other crawlers does Sofya run?
Sofya-User (AI assistant). Each has its own robots.txt token, and each does a different job.

See when AI assistants and crawlers read your site

Add one line to your server and MetricRaven shows which assistants, search engines and training crawlers request your pages, which ones are IP-verified, and the URLs they expected to find, including 404s.