MetricRaven

What is RiverBot?

River · Training crawlers · User agent + IP range

River's crawler, which fetches public pages to train and evaluate River's AI models.

A visit usually means: Public content is being collected that may end up in model training data or large web datasets.

RiverBot user agent

The full user agent string, as River publishes it:

  • User-Agent
    RiverBot/1.0 (+https://river.ai/bot)

Version numbers change, so match the token RiverBot anywhere in the user agent, ignoring case. Source: River's crawler documentation, checked Nov 18, 2026.

Reading the string

  • The published version is RiverBot/1.0. Expect the number to change.
  • It has no browser parts (no Mozilla/5.0 prefix), so it's easy to tell apart from visitors.
  • It carries a link, https://river.ai/bot, so anyone reading their logs can look the crawler up.

Paste a string from your logs into the user agent parser to see which crawler it is. New to the term? Read what a user agent is.

Block or allow RiverBot in robots.txt

River says RiverBot follows robots.txt.

Block everywhere
robots.txt
User-agent: RiverBot
Disallow: /
Keep out of a folder
robots.txt
User-agent: RiverBot
Disallow: /private/
Allow
robots.txt
User-agent: RiverBot
Allow: /

A crawler follows the most specific group that names it, so a rule here overrides your User-agent: * group for this crawler. Well-behaved crawlers re-read robots.txt within about a day.

RiverBot IP ranges and verification

Verified when the user agent and the IP range both match

  1. 1User agent

    The request's user agent contains RiverBot.

  2. 2Request IP

    Your server-side tracker sends the IP that made the request.

  3. 3Range check

    The IP is compared with the ranges River publishes, refreshed twice a day.

Range sources

Check by reverse DNS

River documents a DNS check you can run on any IP in your logs: a reverse DNS lookup of the request's IP should return a hostname ending in bot.river.ai, and a forward lookup of that hostname should return the same IP.

terminal
host <ip>          # → a name ending in bot.river.ai
host <that name>   # → the same <ip>

What RiverBot means for your traffic and revenue

RiverBot collects pages for model training or datasets. It sends no visitors. Blocking it costs no traffic today; allowing it may help future models know about your product.

Most crawlers never run JavaScript, so browser analytics can't see them, and the ones that do shouldn't count as visitors. MetricRaven's tracker ignores RiverBot, and server-side crawl tracking shows which pages it reads instead. See Bots & AI crawlers.

Questions

What is RiverBot?
River's crawler, which fetches public pages to train and evaluate River's AI models. MetricRaven groups it under Training crawlers: crawlers collecting public pages that may be used to train AI models.
What is the RiverBot user agent?
River documents this user agent: "RiverBot/1.0 (+https://river.ai/bot)". Match the token "RiverBot" rather than the whole string, because version numbers change.
How do I block RiverBot in robots.txt?
Add "User-agent: RiverBot" followed by "Disallow: /" to your robots.txt. River says RiverBot follows robots.txt.
Does RiverBot publish IP ranges?
Yes. River publishes the addresses it sends RiverBot from: https://river.ai/riverbot.json. A request that claims to be RiverBot from any other IP is an impostor. You can also check DNS: a reverse DNS lookup of the request's IP should return a hostname ending in bot.river.ai, and a forward lookup of that hostname should return the same IP.
Is RiverBot safe?
The real RiverBot only requests public pages, and River documents it. The risk is impostors using its name, which the published IP ranges catch. Whether to allow it depends on what you get back: public content is being collected that may end up in model training data or large web datasets.

See when AI assistants and crawlers read your site

Add one line to your server and MetricRaven shows which assistants, search engines and training crawlers request your pages, which ones are IP-verified, and the URLs they expected to find, including 404s.