Crawled, Scraped, Strained: Insights on AI Bot Behavior

North America accounts for nearly 90% of observed AI crawler traffic, receiving a heavy skew compared to other regions like Europe, Asia, and Latin America.

Analysis of traffic from mid-April to mid-July 2025 revealed that AI crawlers made up almost 80% of all AI bot traffic observed.

Fetcher bots, including those from ChatGPT and Perplexity, are driving massive real-time request volumes, with some cases exceeding 39,000 requests per minute.

ChatGPT generates the most real-time traffic to websites, with 98% of fetcher bot requests attributable to OpenAI’s bots

Meta’s AI bots generated 52% of AI crawler traffic, which is more than double that of Google (23%) or OpenAI (20%).