Generator

robots.txt generator

Build a starter robots.txt with sitemap directive and disallow rules.

Allow all crawlers (User-agent: *)Sitemap URLDisallow paths (one per line)

User-agent: *
Allow: /
Disallow: /admin
Disallow: /staging

Sitemap: https://example.com/sitemap.xml