What is RiverBot?
River · Training crawlers · User agent + IP range
River's crawler, which fetches public pages to train and evaluate River's AI models.
A visit usually means: Public content is being collected that may end up in model training data or large web datasets.
RiverBot user agent
The full user agent string, as River publishes it:
- User-Agent
RiverBot/1.0 (+https://river.ai/bot)
Version numbers change, so match the token RiverBot anywhere in the user agent, ignoring case. Source: River's crawler documentation, checked Nov 18, 2026.
Reading the string
- The published version is RiverBot/1.0. Expect the number to change.
- It has no browser parts (no Mozilla/5.0 prefix), so it's easy to tell apart from visitors.
- It carries a link, https://river.ai/bot, so anyone reading their logs can look the crawler up.
Paste a string from your logs into the user agent parser to see which crawler it is. New to the term? Read what a user agent is.
Block or allow RiverBot in robots.txt
River says RiverBot follows robots.txt.
User-agent: RiverBot
Disallow: /User-agent: RiverBot
Disallow: /private/User-agent: RiverBot
Allow: /A crawler follows the most specific group that names it, so a rule here overrides your User-agent: * group for this crawler. Well-behaved crawlers re-read robots.txt within about a day.
RiverBot IP ranges and verification
Verified when the user agent and the IP range both match
1User agent
The request's user agent contains
RiverBot.2Request IP
Your server-side tracker sends the IP that made the request.
3Range check
The IP is compared with the ranges River publishes, refreshed twice a day.
Range sources
RiverBot IP addresses
Check by reverse DNS
River documents a DNS check you can run on any IP in your logs: a reverse DNS lookup of the request's IP should return a hostname ending in bot.river.ai, and a forward lookup of that hostname should return the same IP.
host <ip> # → a name ending in bot.river.ai
host <that name> # → the same <ip>What RiverBot means for your traffic and revenue
RiverBot collects pages for model training or datasets. It sends no visitors. Blocking it costs no traffic today; allowing it may help future models know about your product.
Most crawlers never run JavaScript, so browser analytics can't see them, and the ones that do shouldn't count as visitors. MetricRaven's tracker ignores RiverBot, and server-side crawl tracking shows which pages it reads instead. See Bots & AI crawlers.
Questions
- What is RiverBot?
- River's crawler, which fetches public pages to train and evaluate River's AI models. MetricRaven groups it under Training crawlers: crawlers collecting public pages that may be used to train AI models.
- What is the RiverBot user agent?
- River documents this user agent: "RiverBot/1.0 (+https://river.ai/bot)". Match the token "RiverBot" rather than the whole string, because version numbers change.
- How do I block RiverBot in robots.txt?
- Add "User-agent: RiverBot" followed by "Disallow: /" to your robots.txt. River says RiverBot follows robots.txt.
- Does RiverBot publish IP ranges?
- Yes. River publishes the addresses it sends RiverBot from: https://river.ai/riverbot.json. A request that claims to be RiverBot from any other IP is an impostor. You can also check DNS: a reverse DNS lookup of the request's IP should return a hostname ending in bot.river.ai, and a forward lookup of that hostname should return the same IP.
- Is RiverBot safe?
- The real RiverBot only requests public pages, and River documents it. The risk is impostors using its name, which the published IP ranges catch. Whether to allow it depends on what you get back: public content is being collected that may end up in model training data or large web datasets.
See when AI assistants and crawlers read your site
Add one line to your server and MetricRaven shows which assistants, search engines and training crawlers request your pages, which ones are IP-verified, and the URLs they expected to find, including 404s.