This is live traffic data from a sample of our network, classified into four categories: humans, bots, search engine crawlers, and AI crawlers. That last category is new. Most analytics tools still lump AI crawlers into generic bot traffic. This dashboard separates them so you can see what's actually happening as we countdown to bot traffic surpassing human traffic online.
Data from Alli AI's Visibility Engine
·
Updated live
·Methodology
Visits over time
Human62.0%
Bots33.6%
Search Engines2.1%
LLM2.3%
The LLM category is the one to watch. These are crawlers from OpenAI, Anthropic, Perplexity, and others requesting pages to power AI generated answers. This traffic category barely existed two years ago. Most analytics platforms still classify it as generic bot traffic, which means site owners have no visibility into how often AI platforms are accessing their content, or whether those platforms can actually read it.
Top AI crawlers by traffic share
Top search engine crawlers by traffic share
Non human traffic isn't just scrapers and spam anymore. A growing share comes from legitimate AI platform crawlers: OpenAI's GPTBot and ChatGPT-User, Anthropic's ClaudeBot, PerplexityBot, and others. These bots request pages to serve real user queries. That's a fundamentally different kind of bot traffic than what the internet has dealt with historically, and most websites have zero visibility into it.
Visitor Breakdown
Family
Type
Share 1
Unknown
Human
62.00%
Generic Bot
Bot
11.67%
Dot Bot
Bot
6.04%
curl unix CLI http client
Bot
5.05%
Java http library
Bot
1.64%
SEO analysis bot
Bot
1.51%
WordPress spider
Bot
1.41%
Google Bot
Search Engine
1.40%
ChatGPT-User
LLM
1.19%
Ahrefs backlinks research tool
Bot
1.09%
Amazon
Bot
0.99%
Go http client
Bot
0.96%
TikTok
Bot
0.60%
Microsoft Bing
Search Engine
0.52%
Barkrowler
Bot
0.50%
ClaudeBot
LLM
0.47%
Majestic-12 spider
Bot
0.38%
Facebook Bot
Bot
0.33%
Apple
Bot
0.29%
GPTBot
LLM
0.22%
Baidu
Search Engine
0.19%
Chinese search engine
Bot
0.14%
Google Adwords
Bot
0.12%
Google
Bot
0.12%
CCBot
LLM
0.12%
1–25 of 96
Rows per page
Methodology
This dashboard displays live visitor data from a production website monitored by Alli AI's Visibility Engine. Every incoming request is classified into one of four categories based on user-agent analysis and behavioral signals.
Human
Standard browser visits from real users. Identified by full browser user-agent strings and normal rendering behavior.
Bots
Automated crawlers, scrapers, and monitoring tools that are not search engines or AI platforms. Includes SEO tool crawlers (Ahrefs, Majestic), uptime monitors, and unidentified automated agents.
Search Engines
Crawlers from traditional search engines: Googlebot, Bingbot, YandexBot, and others. These bots index pages for conventional search results.
LLM
AI platform crawlers requesting content to power AI-generated answers. Includes GPTBot, ChatGPT-User, OAI-SearchBot (OpenAI), ClaudeBot (Anthropic), PerplexityBot, and others. Matched against 50+ known AI crawler signatures, updated continuously.
Traffic share percentages are calculated per time period based on the proportion of classified visits. The dashboard reflects data from the monitored site only and is not extrapolated to broader internet traffic. Data updates are live with each API refresh.
