Back to tools

Robots.txt generator

Build the file that tells search engines (Googlebot, Bingbot...) which pages of your website they may crawl and which ones they should leave alone.

How do I install it? Copy the text shown here, create a blank file named robots.txt and upload it to the root of your domain via FTP (e.g. example.ch/robots.txt).

robots.txt
User-agent: *
Allow: /
Disallow: /wp-admin/
Disallow: /private/
Disallow: /tmp/