Robots.txt Generator

Generate a valid robots.txt file to control search engine crawling.

Configure Robots.txt

How many seconds search engines should wait before hitting another page.

Specific Directories

Generated Robots.txt

User-agent: *
Allow: /