™
Home
Blog
Contact US
Pricing
Small SEO Tools - Optimize your site for free!
All your keywords, competitors and backlink research in one SEO tool!
Robots.txt Generator
Default - All Robots are:
Allowed
Refused
Crawl-Delay:
Default - No Delay
5 Seconds
10 Seconds
20 Seconds
60 seconds
120 Seconds
Sitemap:
(leave blank if you don't have)
Search Robots:
Google
Same as Default
Allowed
Refused
Google Image
Same as Default
Allowed
Refused
Google Mobile
Same as Default
Allowed
Refused
MSN Search
Same as Default
Allowed
Refused
Yahoo
Same as Default
Allowed
Refused
Yahoo MM
Same as Default
Allowed
Refused
Yahoo Blogs
Same as Default
Allowed
Refused
Ask/Teoma
Same as Default
Allowed
Refused
GigaBlast
Same as Default
Allowed
Refused
DMOZ Checker
Same as Default
Allowed
Refused
Nutch
Same as Default
Allowed
Refused
Alexa/Wayback
Same as Default
Allowed
Refused
Baidu
Same as Default
Allowed
Refused
Naver
Same as Default
Allowed
Refused
MSN PicSearch
Same as Default
Allowed
Refused
Restricted Directories:
The path is relative to root and must contain a trailing slash "/"
Now, Create 'robots.txt' file at your root directory. Copy above text and paste into the text file.
Related Tools
Website Screenshot Generator
Schema Markup Generator
WebPage Size Checker
Favicon Generator Tool
Internet speed test
HTML Compressor
LATEST BLOGS
How to Download YouTube Videos for Offline Viewing
7 Oct
/
1553
views / by
Admin
Facebook Video Downloader Online
7 Oct
/
1184
views / by
Admin
SEARCH
Popular SEO Tools
Plagiarism Checker
Article Spinner / Rewriter
Keyword Position Checker
Grammar Check
Domain Authority Checker
Pagespeed Insights Checker
Reverse Image Search
Page Authority checker
Backlink Checker
Alexa Rank Checker
Backlink Maker
Domain Age Checker
Website Ping Tool
Website Seo Score Checker
Keyword Density Checker
Website Page Size Checker
Word Count Checker
Mozrank Checker
×
Sign In
×
Sign in with your username
Username
Password
×
Sign Up
×
Sign up with your email address
Username
Email
Full Name
Password
×