Robots.txt Generator - Free, Instant Robots TXT Creator



Robots.txt Generator


Default - All Robots are:  
    
Crawl-Delay:
    
Sitemap: (leave blank if you don't have) 
     
Search Robots: Google
  Google Image
  Google Mobile
  MSN Search
  Yahoo
  Yahoo MM
  Yahoo Blogs
  Ask/Teoma
  GigaBlast
  DMOZ Checker
  Nutch
  Alexa/Wayback
  Baidu
  Naver
  MSN PicSearch
   
Restricted Directories: The path is relative to root and must contain a trailing slash "/"
 
 
 
 
 
 
   



Now, Create 'robots.txt' file at your root directory. Copy above text and paste into the text file.


About Robots.txt Generator

This 100% free and most effective robots.txt file generator will create a robots TXT file instantly for your website or blog. That file will help you to boost rankings by allowing Google bots and other search engine bots to easily crawl your web pages and index them as fast as possible.

A Robot.txt generator can be a great help while creating HTML pages or single page websites that are not pre-build or created with a CMS to have a robot.txt file already. This file suggests crawling bots to index a page and don't index a page (follow what the web designer is suggesting).