MetricRaven

What is MojeekBot?

Mojeek · Search indexes · User agent only

The crawler for Mojeek, an independent search engine with its own index.

A visit usually means: The page is being discovered or refreshed so it can appear in search or AI search results.

MojeekBot user agent

User-Agent token
MojeekBot

Mojeek documents the token but not a full string. Requests contain MojeekBot, usually with a version number such as “MojeekBot/1.0” and browser text around it. Match the token anywhere in the user agent, ignoring case.

Paste a string from your logs into the user agent parser to see which crawler it is. New to the term? Read what a user agent is.

Block or allow MojeekBot in robots.txt

Mojeek says MojeekBot follows robots.txt.

Block everywhere
robots.txt
User-agent: MojeekBot
Disallow: /
Keep out of a folder
robots.txt
User-agent: MojeekBot
Disallow: /private/
Allow
robots.txt
User-agent: MojeekBot
Allow: /

A crawler follows the most specific group that names it, so a rule here overrides your User-agent: * group for this crawler. Well-behaved crawlers re-read robots.txt within about a day.

MojeekBot IP ranges and verification

Mojeek publishes no IP ranges for MojeekBot, so requests are identified by user agent only and recorded as unverified. Anyone can send this user agent.

Check by reverse DNS

Mojeek documents a DNS check you can run on any IP in your logs: a reverse DNS lookup of the request's IP should return a hostname ending in mojeek.com, and a forward lookup of that hostname should return the same IP.

terminal
host <ip>          # → a name ending in mojeek.com
host <that name>   # → the same <ip>

What MojeekBot means for your traffic and revenue

MojeekBot decides whether your pages can appear in Mojeek's search results. Blocking it takes you out of them, along with the visitors and sales that search sends.

Most crawlers never run JavaScript, so browser analytics can't see them, and the ones that do shouldn't count as visitors. MetricRaven's tracker ignores MojeekBot, and server-side crawl tracking shows which pages it reads instead. See Bots & AI crawlers.

Questions

What is MojeekBot?
The crawler for Mojeek, an independent search engine with its own index. MetricRaven groups it under Search indexes: search engines and AI search keeping their index fresh.
What is the MojeekBot user agent?
Requests contain the token "MojeekBot", usually with a version number such as "MojeekBot/1.0". Match the token anywhere in the user agent, ignoring case.
How do I block MojeekBot in robots.txt?
Add "User-agent: MojeekBot" followed by "Disallow: /" to your robots.txt. Mojeek says MojeekBot follows robots.txt.
Does MojeekBot publish IP ranges?
No list, but Mojeek documents a DNS check: a reverse DNS lookup of the request's IP should return a hostname ending in mojeek.com, and a forward lookup of that hostname should return the same IP.
Is MojeekBot safe?
The real MojeekBot only requests public pages, and Mojeek documents it. The risk is impostors using its name. Whether to allow it depends on what you get back: the page is being discovered or refreshed so it can appear in search or AI search results.

See when AI assistants and crawlers read your site

Add one line to your server and MetricRaven shows which assistants, search engines and training crawlers request your pages, which ones are IP-verified, and the URLs they expected to find, including 404s.