robots.txt Tools And TutorialHits: 619
*****
Tools to automatically creat and validate robot.txt file and a tool to create a .htaccess file to ban bad robots. Also includes a general robots.txt tutorial.
Platform(s): n/a
Date: Mar, 12 2003 Author: http://www.clockwatchers.com/robots_main.html {
Ratings}Number of Ratings: 303 Votes
Visitor Voting Booth:
|