robotstxt analytics tool 1.0

License: Free ‎File size: 540 bytes
‎Users Rating: 3.0/5 - ‎1 ‎votes

This robots.txt analysis tool can easily verify the content of "robots.txt" of an arbitrary web server (file that specifies behavior on the server for the robot of the search engine etc.) from online.

VERSION HISTORY

  • Version 1.0 posted on 2008-04-07

Program Details