- Robots.txt File Generator - http://www.webtoolcentral.com/webmaster/tools/robots_txt_file_generator/
Assists in creating robots.txt files for controlling page inclusion and exclusion in search engines.
- Robots.txt Validator - http://www.searchengineworld.com/cgi-bin/robotcheck.cgi
Checks your robots.txt to insure it conforms to the robots exclusion standard.
- Robots.txt Syntax Checker - http://www.sxw.org.uk/computing/robots/check.html
Online tool for syntax verification to robots.txt files, provided by Simon Wilkinson.
- Robots.txt Checker - http://tool.motoricerca.info/robots-checker.phtml
Analyzes a robots.txt file searching for syntax and "logical" errors, and shows a summary of what effect it will have.
- Robots.txt Validation - http://www.clockwatchers.com/robots_tool.html
Creator and validator of robots.txt files.
- Robots.txt Generator - http://www.robotstxt.ca/
Information on the use of robots.txt as well s a robots.txt generator and a list of search engine robots.
|
