This is live traffic data from a sample of our network, classified into four categories: humans, bots, search engine crawlers, and AI crawlers. That last category is new. Most analytics tools still lump AI crawlers into generic bot traffic. This dashboard separates them so you can see what's actually happening as we countdown to bot traffic surpassing human traffic online.
Data from Alli AI's Visibility Engine
·
Updated live
·Methodology
Visits over time
Human55.8%
Bots31.2%
Search Engines2.0%
LLM11.0%
The LLM category is the one to watch. These are crawlers from OpenAI, Anthropic, Perplexity, and others requesting pages to power AI generated answers. This traffic category barely existed two years ago. Most analytics platforms still classify it as generic bot traffic, which means site owners have no visibility into how often AI platforms are accessing their content, or whether those platforms can actually read it.
Top AI crawlers by traffic share
Top search engine crawlers by traffic share
Non human traffic isn't just scrapers and spam anymore. A growing share comes from legitimate AI platform crawlers: OpenAI's GPTBot and ChatGPT-User, Anthropic's ClaudeBot, PerplexityBot, and others. These bots request pages to serve real user queries. That's a fundamentally different kind of bot traffic than what the internet has dealt with historically, and most websites have zero visibility into it.
Visitor Breakdown
Family
Type
Share 1
Unknown
Human
55.78%
WordPress spider
Bot
11.04%
Generic Bot
Bot
11.04%
Dot Bot
Bot
4.54%
PetalBot
LLM
2.12%
ChatGPT-User
LLM
1.44%
SEO analysis bot
Bot
1.44%
Google Bot
Search Engine
1.42%
Applebot
LLM
1.14%
Bytespider
LLM
1.12%
Amazonbot
LLM
0.66%
Barkrowler
Bot
0.65%
TikTokSpider
LLM
0.58%
Ahrefs backlinks research tool
Bot
0.57%
Microsoft Bing
Search Engine
0.57%
Majestic-12 spider
Bot
0.43%
Amzn-SearchBot
LLM
0.41%
LinkupBot
LLM
0.34%
facebookexternalhit
LLM
0.30%
meta-externalagent
LLM
0.30%
spider
LLM
0.29%
ClaudeBot
LLM
0.29%
Google Adwords
Bot
0.26%
GPTBot
LLM
0.24%
Java http library
Bot
0.22%
1–25 of 142
Rows per page
Methodology
This dashboard displays live visitor data from a production website monitored by Alli AI's Visibility Engine. Every incoming request is classified into one of four categories based on user-agent analysis and behavioral signals.
Human
Standard browser visits from real users. Identified by full browser user-agent strings and normal rendering behavior.
Bots
Automated crawlers, scrapers, and monitoring tools that are not search engines or AI platforms. Includes SEO tool crawlers (Ahrefs, Majestic), uptime monitors, and unidentified automated agents.
Search Engines
Crawlers from traditional search engines: Googlebot, Bingbot, YandexBot, and others. These bots index pages for conventional search results.
LLM
AI platform crawlers requesting content to power AI-generated answers. Includes GPTBot, ChatGPT-User, OAI-SearchBot (OpenAI), ClaudeBot (Anthropic), PerplexityBot, and others. Matched against 50+ known AI crawler signatures, updated continuously.
Traffic share percentages are calculated per time period based on the proportion of classified visits. The dashboard reflects data from the monitored site only and is not extrapolated to broader internet traffic. Data updates are live with each API refresh.
