Robots.txt Generator

Generate robots.txt rules for search engine crawlers.

100% Browser-Based

Files Never Leave Your Device

No Server Uploads

Zero Data Collection

How It Works

Pick from Allow All, Block All, Standard, or Block AI bots.

Configure user-agent, allow, and disallow paths.

Copy the generated robots.txt and upload to your site root.

Allow All, Block All, Standard, and Block AI Bots.

Add rules for different user agents.

Include sitemap URL and crawl delay.

Always outputs valid robots.txt format.

Where do I put robots.txt?

Upload to your website root: https://yourdomain.com/robots.txt