Free robots.txt Generator
Generate a robots.txt file for your website to instruct search engine crawlers which pages to crawl and which to ignore. Set allow/disallow rules, add a sitemap URL, and configure crawl delay. Copy the output and upload it as robots.txt to your site root.
How to Use
- Select the user-agent (all robots or specific crawlers)
- Add allow and disallow paths
- Add your sitemap URL
- Copy the generated text and save as robots.txt
Privacy
All processing happens locally. No data is transmitted.
Last reviewed: July 2026.