Cloudflare aggregates and graphs the number of website visits by various AI bots, and which AI bot is the most active?
AI companies use bots to collect information from websites across the internet to gather training data for their AI. Various chat AIs also access websites to answer user questions. Cloudflare has published an analysis of traffic related to such AI.
The crawl-to-click gap: Cloudflare data on AI bots, training, and referrals
Below is a graph summarizing the traffic trends of websites around the world driven by AI bots. As of August 18, 2025, OpenAI's 'GPT Bot' recorded the most traffic.
The graph below shows the percentage of each AI bot in overall traffic. The colored bars show the percentage in July 2025, and the gray bars show the percentage in July 2024. While OpenAI's 'GPT Bot,' Meta's 'Meta-ExternalAgent,' and Anthropic's 'ClaudeBot' saw significant increases in their percentages, Amazon's 'Amazonbot' and ByteDance's 'Bytespider' saw significant decreases.
The graph below shows the purpose of crawling by AI bots. Blue indicates 'AI learning,' light blue indicates 'search,' orange indicates 'unknown,' and khaki indicates 'user action.' Throughout the year up to August 18, 2025, the most common purpose of access was learning.
The graph below shows the change in crawling purpose. The percentage of accesses for learning purposes increased slightly compared to 2024, while the percentage of accesses for search purposes decreased.
Cloudflare publishes the analysis results of access by AI bots at the following link.
AI Insights | Cloudflare Radar
https://radar.cloudflare.com/ai-insights
Related Posts:
in Web Service, Posted by log1o_hf