Small SEO Tools - Optimize your site for free!

All your keywords, competitors and backlink research in one SEO tool!

Robots.txt Generator


Default - All Robots are:  
    
Crawl-Delay:
    
Sitemap: (leave blank if you don't have) 
     
Search Robots: Google
  Google Image
  Google Mobile
  MSN Search
  Yahoo
  Yahoo MM
  Yahoo Blogs
  Ask/Teoma
  GigaBlast
  DMOZ Checker
  Nutch
  Alexa/Wayback
  Baidu
  Naver
  MSN PicSearch
   
Restricted Directories: The path is relative to root and must contain a trailing slash "/"
 
 
 
 
 
 
   



Now, Create 'robots.txt' file at your root directory. Copy above text and paste into the text file.



Related Tools

Htaccess Redirect Generator Htaccess Redirect Generator
URL Encoder / Decoder URL Encoder / Decoder
Suspicious Domain Checker Suspicious Domain Checker
Website Reviewer Website Reviewer
Online Ping Website Tool Online Ping Website Tool
Wordpress Theme Detector Wordpress Theme Detector


LATEST BLOGS

4 Best SEO tools to use in 2021 – To Get Results

4 Best SEO tools to use in 2021 – To Get Results

24 May  / 2058 views  /  by Admin
Know Types and Best Tools of SEO

Know Types and Best Tools of SEO

24 May  / 1032 views  /  by Admin