Robots.txt Generator
Create a simple robots.txt file for your website to guide search engine crawlers.
Control crawler access
Choose which directories should be blocked or allowed, then copy the generated robots.txt rules.
Enter a site URL and optional paths to generate robots.txt.
