Insights · Industry Data

More than half the internet is now bots. Here's what that means for your AI visibility.

Cloudflare data shows agent traffic has passed 50% of the internet and AI training drives 52% of crawler requests. What it means for B2B shortlists.

Key points

  • Cloudflare reports that agent traffic crossed 50% of all internet traffic for the first time in 2026, so more than half of what reaches a website is now a machine, not a person.
  • According to Cloudflare, AI training now accounts for 52% of crawler requests, up from 22% in spring 2025, and mixed-use crawlers make up more than 36% of crawler activity.
  • Cloudflare estimates that of every hour spent researching online, only 15 minutes is now spent on the open web; the rest is spent reading a generated answer.
  • Cloudflare says the shift is industry-agnostic: retail, software, IT and finance show the same pattern as media, with some heavily crawled categories losing up to 40% of human traffic in under a year.
  • Traffic data cannot show what AI tells a buyer about a business; that can only be measured by asking AI the buyer's questions and reading the answers.
Mixed-use crawler
A bot that combines search indexing, AI training and live agent retrieval in one undeclared visit, so a site owner cannot tell which purpose a given visit served.

Cloudflare published a report this month with a number worth sitting with: more than half of all internet traffic is now non-human. Cloudflare sits behind more than 20% of the web, so this is not a small sample. It is one of the most complete views available of what is happening to web traffic as AI adoption accelerates. For a B2B business trying to decide whether AI visibility is a real commercial issue or an inflated worry, the report is useful because the numbers are independent, measured and considerably starker than most people assume.

What did Cloudflare's report find?

Cloudflare found that agent traffic now makes up more than half of all internet traffic, that AI training drives most crawler requests, and that most online research time is now spent reading generated answers rather than websites. Its Content Independence Day report, published 1 July 2026, marks one year since Cloudflare changed how it treats AI training crawlers by default. It is a data release rather than an opinion piece, and three figures stand out.

50%+ of all internet traffic is now agent traffic (non-human) for the first time on record
52% of crawler requests are now for AI training, up from 22% in spring 2025
15 min of every hour spent researching online is now spent on the open web; the rest is a generated answer

Cloudflare also reports that generative AI adoption has moved faster than any previous technology shift: more than 30% of humanity, some 2.5 billion people, now use generative AI regularly, a level reached in roughly 3.5 years, more than twice the speed of smartphone adoption. Mixed-use crawlers, which blend search indexing, AI training and live agent retrieval into a single undeclared pass, now account for more than 36% of crawler activity.

Why does this statistic matter to a B2B business?

It matters because it measures a change in how buyers research, not just a change in traffic volume. Traffic reports usually measure something you can act on directly: more visitors, fewer visitors, where they came from. When Cloudflare says only 15 minutes of every hour spent researching online happens on the open web, it is describing a buyer who used to click through five or six sites to compare options, and now types one question into an AI tool and gets a single, consolidated answer, often without seeing a website at all.

If a buyer's research can now happen inside an AI answer, then the content of that answer matters as much as your website once did: whether it names you, describes you accurately and recommends you ahead of competitors. Cloudflare's data is the market-level evidence for a shift Genivista measures one company at a time, as the Gap between a business and the competitor AI recommends instead.

Half the internet is now machines. The question that matters is not how much traffic is a bot, but what the bot tells the human on the other end.

Is this only a problem for publishers and media?

No. Cloudflare is explicit that the pattern first visible in news and media has become "industry-agnostic", with retail, software, IT and finance now seeing the same dynamics. Some of the most heavily crawled categories in Cloudflare's data have seen human traffic decline by as much as 40% in under a year, and Cloudflare notes that many publishers are preparing for what they call "Google Zero": little or no traffic arriving from search referrals at all.

For a B2B company, the relevant translation is not "our traffic will drop 40%". It is this: if the category conversation increasingly happens inside AI systems rather than on search results pages, then whatever those systems say about you, accurate or not, ahead of or behind your competitors, is quietly shaping shortlists you will never see. That is the argument in our related piece on the deals you can't see you're losing.

What are mixed-use crawlers, and why do they matter commercially?

Mixed-use crawlers are bots that combine search indexing, AI training and live agent retrieval in one undeclared visit, and they now make up more than a third of crawler activity. A business cannot tell whether a given visit helped it appear in search, shaped a model's long-term "memory" of the business, or answered a live buyer question. Cloudflare singles out Google's crawler as the largest example, noting that Google holds roughly twice the access of other leading AI companies because taking part in its search also feeds its AI systems.

The commercial consequence: a business can no longer assume that good search performance and good AI visibility are the same thing, or that one report measures both. Search rankings and site analytics say little about whether you make the shortlist an AI answer gives a buyer. Our piece on why AI search and Google search are different things covers this distinction in more depth.

What should a B2B business do with this data?

Measure what AI says about you before deciding anything else. Cloudflare's report is about infrastructure and economics: who crawls, how much, and who gets paid. It does not tell an individual business what AI says when a buyer asks about its category. That can only be answered by asking AI the questions a buyer would ask and reading, unedited, what comes back.

  • Crawl volume is not visibility. Being crawled heavily says nothing about whether you are cited, described accurately or recommended.
  • Traffic-based dashboards increasingly miss the moment that matters: the AI answer a buyer never clicks through from.
  • The commercial question is your position on the shortlist, against the competitor AI names instead of you.

The starting point is a Genivista Gap Check: a report, at no charge, with a walk-through from Neil if you want one, showing the Gap between you and the leading competitor on ChatGPT, Gemini and Perplexity. If the Gap is worth closing, a Gap Audit explains why it exists and what to fix first.

Source: Cloudflare, "Content Independence Day, one year on: building the business model for the agentic Internet," published 1 July 2026, compiled from Cloudflare Radar and Cloudflare's 2026 Investor Day presentation.

Questions

Is more than half of internet traffic really non-human?

According to Cloudflare's July 2026 report, yes: agent traffic crossed 50% of all internet traffic for the first time this year. Cloudflare sits behind more than 20% of the web, including 36% of the world's most-visited sites, which gives it one of the largest vantage points available for this measurement.

What is a mixed-use crawler, and why does it matter?

A mixed-use crawler blends search indexing, AI training and live agent retrieval into a single bot, so a site owner cannot tell which purpose a visit served. Cloudflare reports these now account for more than 36% of crawler activity, which means search performance and AI visibility can no longer be assumed to be the same thing.

Does this affect B2B companies, or just publishers and media?

Cloudflare's report says the effect is industry-agnostic, with retail, software, IT and finance seeing the same pattern media saw first. Any B2B company whose buyers research online before making contact is affected, because that research increasingly happens inside an AI answer.

If AI is reading my site more than humans are, does that mean more visibility?

Not necessarily. Being crawled is not the same as being cited, and being cited is not the same as being recommended. A business can be crawled heavily and still be absent, misdescribed or displaced by a competitor in AI answers.

What should a business do in response to this data?

Measure what AI says when a buyer asks about your category, by asking the questions a buyer would ask rather than reading traffic data. A Genivista Gap Check does this at no charge and shows the Gap between you and the leading competitor on ChatGPT, Gemini and Perplexity.

Sources

  1. “Content Independence Day, one year on: building the business model for the agentic Internet”, Arielle Weiss, Zach Albertson and Emily Lanfear, Cloudflare, . Data release drawn from traffic on cloudflare's network, which sits in front of more than 20% of the web; crawler-purpose figures as of june 2026. https://blog.cloudflare.com/agentic-internet-bot-report

Related

Cite this article: Neil Harte, “More than half the internet is now bots. Here's what that means for your AI visibility.”, Genivista, 3 July 2026. https://www.genivista.com/insights/more-than-half-the-internet-is-now-bots

What is your Gap?

Send your website, the market you want measured and your top three competitors for that market. Genivista sends you a Gap Check report at no charge, and Neil offers to walk you through it.