robots.txt generator

Make a robots.txt with allow and block rules and a sitemap line.