Meta tags Resources

Control How AI Sees Your Site: Technical Guide for GPTBot, Claude, and Perplexity

Want to control what AI can see on your site? This technical guide shows exactly how to direct AI crawlers using robots.txt, meta tags, and HTTP headers to maximize visibility or protect private content.

Sam Hogan · CEO of Split, Design/GTM Engineer at Origami (YC F24)