robots.txt generator — Rules builder + copy (local)
Compose User-agent groups with Allow/Disallow paths, Crawl-delay, Sitemap URLs, and optional Host. Start from presets (allow all, block AI, WordPress, Next.js), then copy or download robots.txt — generated only in your tab.
Frequently asked questions
No. robots.txt rules are composed entirely in your browser; nothing is uploaded. Nothing is sent to LocalTools servers for processing.
No—robots.txt is advisory. Well-behaved bots usually respect User-agent / Allow / Disallow and Sitemap, but Crawl-delay and Host are non-standard and support varies. Malicious scrapers often ignore the file. Always verify with Search Console or a crawler tester after deploying.