Robots.txt Generator

Build a robots.txt file for your website — add per-agent rules, a sitemap URL, and crawl delay.

Presets

Disallow all bots (block everything)

Add a Rule

User-agent

Custom agent name

Permission

Disallow Allow

Path

Rules (0)

No rules added yet.

Sitemap URL (optional)

Crawl-delay (optional, seconds)

robots.txt Output