Skip to content
DT
en fr ru

robots.txt generator

Build a robots.txt with user-agent, allow, disallow, crawl-delay and sitemap rules.

Input

Fill in the fields below, then run the tool.

Processed on the server and never stored. Press Ctrl/⌘ + Enter to run.

Clear

About this tool

Build a robots.txt with user-agent, allow, disallow, crawl-delay and sitemap rules.

Related tools

Address Generator
Random postal addresses with street, city, region and postcode for the United States, the United Kingdom, Germany, France and Russia.
Generators
Barcode generator
Generate Code 128 or EAN-13 barcodes as PNG.
Generators
BIC / SWIFT Generator
Generate ISO 9362 BIC/SWIFT codes: a four-letter bank code, a two-letter country, a two-character location and an optional three-character branch.
Generators
Credit Card Number Generator
Test card numbers for Visa, Mastercard, American Express, Discover, JCB and Diners Club with the correct IIN prefix, length and Luhn check digit.
Generators