Cloudflare's CEO Matthew Prince sat down for a long interview about how AI is rewiring the plumbing of the internet, and the details matter for any business that publishes anything online, not just tech companies.
The starting point is a number that sounds abstract until you think about what it means for your own website. Cloudflare reports that automated systems now generate most web traffic, with 57.4 percent of requests coming from bots and the rest from humans. That is the first time in the history of the web that computer programs, not people, make up the majority of visitors to an average page. Cloudflare is positioned to see this clearly because it handles roughly a fifth of all global web traffic, sitting between websites and everyone, or everything, trying to reach them.
Cloudflare's response is to build a toll booth. The company launched a system called pay-per-crawl, where website owners can let AI crawlers scrape their site at a set rate, a small payment for every visit, or block them outright. Starting in mid September, the defaults change too: training and agent crawlers get blocked automatically on pages that carry ads, while search crawling stays allowed. That effectively pressures companies like Google to either pay for the content their AI learns from or lose access to it.
Why should a steel manufacturer or an insurance consultancy care about a plumbing change on the internet? Because whatever your business publishes, whether that is product pages, technical guides, or local sponsorship content, is increasingly read by machines that summarize it for someone else, without sending a visitor to your site or clicking an ad. Wikipedia is the clearest early casualty. Human page views on the site fell 8 percent between March and August compared with the same months a year earlier, as more people got their answer straight from a chatbot instead of clicking through.
The flip side is that content licensing is turning into real money. Anthropic already agreed to pay authors roughly three thousand dollars per book after training its Claude chatbot on pirated copies of their work, in a settlement that became the largest copyright payout in United States history. Expect more of this. Any company sitting on a large, unique library of text, whether that is product manuals, claims data, or years of local reporting, now has something AI companies might pay for instead of just taking.
Cloudflare's own house shows the other side of the AI story. Despite revenue that kept climbing every quarter, the company cut roughly a fifth of its staff this year, its first major layoffs in sixteen years, with Prince arguing that AI tools made an entire layer of middle management and internal auditing unnecessary. Investors were not impressed. The stock sank sharply the day the cuts were announced, even after the company beat its own earnings estimates.
That gap between what a CEO calls smart restructuring and what the market reads as a warning sign is worth remembering. The same AI tools being pitched as a way to charge bots for content are also being used, right now, to decide which of your employees still have a job.