“Tracks GPTBot, ClaudeBot, PerplexityBot and other AI crawlers.”
“Shows the most frequently accessed URLs.”
“Breaks activity down by crawler, provider, hostname and page path.”
“Includes request trends and crawler management.”
“Pricing: Available on all Cloudflare plans, with some analytics limitations on free plans.”
“Pricing: Available on all Cloudflare plans, with some analytics limitations on free plans.”
“Shows which LLM bots visit your website.”
“Identifies the specific pages they request.”
“Breaks down bots by provider and purpose (training, indexing, agentic).”
“Allows page-level analysis and CSV exports.”
“Pricing: Requires Webflow Team or Enterprise with the relevant Analyze add-on.”
“Tracks AI crawlers on individual pages.”
“Identifies GPTBot, ChatGPT-User, ClaudeBot, PerplexityBot and others.”
“Highlights which pages bots can and cannot access.”
“Combines crawler data with Google Analytics and Search Console data.”
“Interesting: Specifically designed to connect AI crawler activity with AI visibility.”
“Maya – LLM Site Visibility”
“Tracks AI crawler requests and pages crawled.”
“Provides per-bot breakdowns.”
“Shows pages, errors and blocked requests.”
“Connects to Cloudflare, Vercel or log streaming.”
“Interesting: More focused on technical AI crawler monitoring.”
“Tracks AI crawlers using server logs.”
“Shows which bots visit which URLs and how often.”
“Offers bot verification to distinguish genuine crawlers from spoofed user agents.”
“Connects crawl activity with AI citations and referral traffic.”
“Shows daily AI crawler activity.”
“Lists the most frequently crawled URLs.”
“Breaks down traffic by bot and AI provider.”
“Categorizes activity by AI assistant, search and training intent.”