What does this tool do?
Generate robots.txt from explicit user-agent groups, allow/disallow paths and sitemap URLs without crawling. Inputs: User-agent groups, Sitemap URLs. Outputs: robots.txt text.
How to use it?
Enter user-agent groups, sitemap urls, then choose “Generate”. Copy copies the displayed result or the labeled example/decoded value. Download saves the generated .txt locally. Clear removes inputs and results and restores initial options.
Processing is local. Entered URLs are data: they are not visited, uploaded, logged or placed in the route. Generated markup is inert text. Reference lookups use bundled data, and previews are illustrative rather than guaranteed platform output.
robots.txt controls crawler guidance. It is not an access-control or security mechanism.
Paths start with /; use percent encoding for spaces or #. No rows produces an empty robots.txt.