GEOTechnical SEO
How to let AI crawlers in: robots.txt for GPTBot, ClaudeBot and PerplexityBot
A practical guide to the AI user agents that matter, what each one does, and a robots.txt you can copy that lets assistants cite you without giving away the whole site.
· 4 min read