Java Robot Exclusion Compliance Library 0.1

License: Free ‎File size: N/A
‎Users Rating: 4.0/5 - ‎1 ‎votes

A Java library for complying with the standard Web Robot Exclusion Protocol, robots.txt.

VERSION HISTORY

  • Version jrobotx-0.1 posted on 2009-01-31
    Several fixes and updates
  • Version jrobotx-0.1 posted on 2009-01-31

Program Details