Robots.txt AI Recommender

A wrong robots.txt can deindex your whole site. Tell us your site type and any paths to block, and get a clean, commented robots.txt that protects your crawl budget without blocking important pages.