ToolEmpire

robots.txt Generator Online

Build a robots.txt with disallow rules and sitemap. Runs in any browser, no install.

Inputs

Results

User-agent: *

About this tool

Enter paths to block, crawl delay, and sitemap URL to get a ready-to-upload robots.txt. No install — it runs in any browser and nothing is sent to a server.

How to use

  1. 1Enter Domain, Sitemap URL and Disallowed paths.
  2. 2Adjust the remaining inputs to match your case.
  3. 3Read the result in the results.
  4. 4Everything runs in your browser — nothing is uploaded or stored.

Frequently asked questions

Related tools