“Yes. Scrunch AI offers AI crawler access audits, including checks specifically designed to identify whether your robots.txt configuration is blocking important AI bots.”
+ robots.txt and AI crawler access auditing
“Scrunch's Site Audit evaluates whether AI crawlers can access your website.”
+ AI bot traffic monitoring
“Scrunch also has an Agent Traffic feature.”
+ CDN and hosting integrations
“Supported integrations include Cloudflare, Akamai, AWS CloudFront, Fastly, Vercel and WordPress.”
+ AI bot type guidance
“Scrunch has a useful guide explaining these distinctions: Understanding AI Bot Types .”
− no historical report of every bot explicitly denied by robots.txt
“These aren't quite the same as a historical report of every bot explicitly denied by robots.txt.”