Blog
Bot traffic
How to spot server throttling and inconsistent status codes blocking your crawlers
Intermittent 403, 429, 503 responses to Googlebot and AI crawlers quietly drop pages from search and AI answers. Here is how to detect, diagnose, and fix it.
See the non-human half of your traffic.
Lume shows you every crawler, scraper and AI agent on your site, and verifies which ones are real. Set up in minutes.
Start for free →