What is Sogou web spider?
Sogou · Search indexes · User agent only
Sogou search's crawler: it visits and stores pages and follows their links so people can find them in Sogou search.
A visit usually means: The page is being discovered or refreshed so it can appear in search or AI search results.
Sogou web spider user agent
Sogou web spiderSogou documents the token but not a full string. Requests contain Sogou web spider, usually with a version number such as “Sogou web spider/1.0” and browser text around it. Match the token anywhere in the user agent, ignoring case.
Paste a string from your logs into the user agent parser to see which crawler it is. New to the term? Read what a user agent is.
Block or allow Sogou web spider in robots.txt
Sogou says Sogou web spider follows robots.txt.
User-agent: Sogou web spider
Disallow: /User-agent: Sogou web spider
Disallow: /private/User-agent: Sogou web spider
Allow: /A crawler follows the most specific group that names it, so a rule here overrides your User-agent: * group for this crawler. Well-behaved crawlers re-read robots.txt within about a day.
Sogou web spider IP ranges and verification
Sogou publishes no IP ranges for Sogou web spider, so requests are identified by user agent only and recorded as unverified. Anyone can send this user agent.
What Sogou web spider means for your traffic and revenue
Sogou web spider decides whether your pages can appear in Sogou's search results. Blocking it takes you out of them, along with the visitors and sales that search sends.
Most crawlers never run JavaScript, so browser analytics can't see them, and the ones that do shouldn't count as visitors. MetricRaven's tracker ignores Sogou web spider, and server-side crawl tracking shows which pages it reads instead. See Bots & AI crawlers.
Questions
- What is Sogou web spider?
- Sogou search's crawler: it visits and stores pages and follows their links so people can find them in Sogou search. MetricRaven groups it under Search indexes: search engines and AI search keeping their index fresh.
- What is the Sogou web spider user agent?
- Requests contain the token "Sogou web spider", usually with a version number such as "Sogou web spider/1.0". Match the token anywhere in the user agent, ignoring case.
- How do I block Sogou web spider in robots.txt?
- Add "User-agent: Sogou web spider" followed by "Disallow: /" to your robots.txt. Sogou says Sogou web spider follows robots.txt.
- Does Sogou web spider publish IP ranges?
- No. Sogou publishes no IP ranges for Sogou web spider, so only the user agent identifies it, and anyone can send that string.
- Is Sogou web spider safe?
- The real Sogou web spider only requests public pages, and Sogou documents it. The risk is impostors using its name. Whether to allow it depends on what you get back: the page is being discovered or refreshed so it can appear in search or AI search results.
See when AI assistants and crawlers read your site
Add one line to your server and MetricRaven shows which assistants, search engines and training crawlers request your pages, which ones are IP-verified, and the URLs they expected to find, including 404s.