Robots.txt Generator

Search Engine Optimization

Robots.txt Generator

Default - All Robots are:  
Sitemap: (leave blank if you don't have) 
Search Robots: Google
  Google Image
  Google Mobile
  MSN Search
  Yahoo MM
  Yahoo Blogs
  DMOZ Checker
  MSN PicSearch
Restricted Directories: The path is relative to root and must contain a trailing slash "/"

Now, Create 'robots.txt' file at your root directory. Copy above text and paste into the text file.

About Robots.txt Generator

Enter more information about the Robots.txt Generator tool!

Our Robots.txt Generator tool are web-based tool that can be used to create a robots.txt file for a website. A robots.txt file is a text file that is placed in the root directory of a website and it tells search engine crawlers which parts of the website they are allowed to crawl.

Robots.txt file can be a valuable tool for website owners who want to control how search engine crawlers access their website. By using a robots.txt file, website owners can prevent search engine crawlers from crawling certain parts of their website, such as the website's backend or the website's trash folder.