MetricRaven

Tracking

What is bot traffic?

Bot traffic is any request to your website made by automated software instead of a person, from search engine and AI crawlers to scrapers, uptime monitors and click fraud. In analytics it inflates visitors and lowers conversion rates unless it is filtered out.

Updated

What bot traffic is

Bots are programs that load web pages. Some you want: Googlebot indexes your pages for search, and AI crawlers like GPTBot read them for assistants that may later cite you. Some you don't: scrapers copying content, credential stuffers, fake signups, and click bots draining ad budgets.

There is a lot of it. Imperva's 2025 Bad Bot Report found that automated traffic made up 51% of all web traffic in 2024, the first time in a decade it passed human activity, and that bad bots alone were 37%.

How to spot bot traffic in your reports

  • A sudden spike of new visitors with one pageview each and near-100% bounce rate.
  • Most of the spike labeled direct, from one city or a data-center location, on desktop Chrome.
  • Session times of zero or exactly the same length.
  • Conversion rate falling while revenue stays flat: more visitors, no more buyers.
  • A user agent naming a crawler or a headless browser.

Simple crawlers never run JavaScript, so script-based analytics doesn't see them at all. The ones that show up run a real browser, often on a cloud server.

How to handle it

  • Filter known automation and traffic from cloud and hosting networks out of visitor counts.
  • Exclude your own uptime checks, test runs and staging hosts.
  • Judge channels by paying customers, which bots rarely become, rather than by visits.
  • Measure the crawlers you do care about separately, from your server logs or middleware, since they don't run your script.

Common mistakes

  • Blocking every bot. Blocking search and AI crawlers in robots.txt can remove you from search results and AI answers.
  • Reading a bot spike as a launch success. Check purchase rate and revenue before celebrating traffic.
  • Filtering by user agent alone. Bad bots copy real browser user agents.
  • Forgetting ad fraud. Paid clicks from bots show up as visits that never convert; compare spend with paying customers per campaign.

How MetricRaven handles bot traffic

The MetricRaven script doesn't track automated browsers such as headless or test automation. Exclude data-center traffic is on by default: pageviews, goals and engagement from cloud and hosting networks (AWS, Google Cloud, Azure, DigitalOcean, Hetzner and others) aren't stored, shown or counted toward your plan. Settings shows how many hits were excluded in the last 30 days. Server events and payments are never affected.

Crawlers you want to see are tracked separately: @metricraven/ai-crawl reports GPTBot, ClaudeBot, Googlebot and other known crawlers from your server or edge, and Bot traffic settings let you exclude whole companies or single agents. Look up any crawler in the crawler directory. See Bot traffic settings and Bots & AI crawlers.

Questions

How much web traffic is bots?
Imperva's 2025 Bad Bot Report put automated traffic at 51% of all web traffic in 2024, with bad bots at 37%. Your site's share depends on how attractive it is to scrapers and crawlers.
How do I know if my traffic is from bots?
Look for spikes of one-page, zero-time visits from one location or data center, mostly direct, with no rise in signups or revenue. A user agent parser shows what a suspicious user agent claims to be.
Should I block AI crawlers?
Only if you don't want AI assistants to read your content. Blocking them can keep your pages out of AI answers that send visitors. Measure what they crawl first.
Does bot traffic hurt SEO?
Good crawlers are how search engines find you. Bad bots don't directly change rankings, but heavy scraping can slow your server, and inflated visits distort the data you use to decide what to work on.
Full glossary

Keep bots out of your revenue numbers

MetricRaven filters automated browsers and data-center traffic by default and tracks the AI and search crawlers you want to see.

14-day free trial, no card required.