Blog

AI agents

AI agents Jul 25, 2026

How to get cited in Google AI Overviews and ChatGPT

A practical guide to earning citations in Google AI Overviews and ChatGPT, then confirming they worked by measuring the AI-referral traffic they send back.

AI agents Jul 25, 2026

llms.txt explained: what it is and how to create one

llms.txt is a proposed Markdown file that points AI models to your best content. Here is how to create one, plus the 2025-2026 evidence on whether crawlers use it.

AI agents Jul 25, 2026

How to optimize your site for AI search

AI search optimization starts with a technical question most guides skip: can AI crawlers actually reach and read your content? Here is the checklist.

AI agents Jul 25, 2026

How to see ChatGPT and Perplexity referral traffic

AI referral traffic is the humans arriving from ChatGPT, Perplexity, and Gemini. Here are the exact referrer hostnames, GA4 setup, and the gotchas that hide it.

AI agents Jul 25, 2026

What is GPTBot? A field guide to AI crawlers

GPTBot is OpenAI's training crawler. Learn what it does, its user-agent token, and how it differs from the search and user-fetch bots you should not block.

See the non-human half of your traffic.

Lume shows you every crawler, scraper and AI agent on your site, and verifies which ones are real. Set up in minutes.

Start for free →