Robots.txt Generator


Default - All Robots are:  
    
Crawl-Delay:
    
Sitemap: (leave blank if you don't have) 
     
Search Robots: Google
  Google Image
  Google Mobile
  MSN Search
  Yahoo
  Yahoo MM
  Yahoo Blogs
  Ask/Teoma
  GigaBlast
  DMOZ Checker
  Nutch
  Alexa/Wayback
  Baidu
  Naver
  MSN PicSearch
   
Restricted Directories: The path is relative to root and must contain a trailing slash "/"
 
 
 
 
 
 
   



Now, Create 'robots.txt' file at your root directory. Copy above text and paste into the text file.


About Robots.txt Generator

The Robots.txt Generator tool is a txt file that is required for indexing or noindex of which search engines pages. The first thing that robots on search engines look for on your site is the robots.txt file. You will come to this file to analyze your site and find out on which pages you need to navigate. That's why robots.txt is very important. If you need to create a robots.txt file, this is the tool you are looking for.