This robots.txt analysis tool can easily verify the content of "robots.txt" of an arbitrary web server (file that specifies behavior on the server for the robot of the search engine etc.) from online.
VERSION HISTORY
- Version 1.0 posted on 2008-04-07
Program Details
- Category: Network & Internet > Other
- Publisher: lionheart
- License: Free
- Price: N/A
- Version: 1.0
- Platform: windows