SimplerCrawler 0.1

License: Free ‎File size: N/A
‎Users Rating: 3.0/5 - ‎1 ‎votes

Very simple single-thread crawler for web (http) written in perl. Supports links following rules and collections to grab information of visited pages (regexp based).

VERSION HISTORY

  • Version cwlr-0.1.zip posted on 2006-02-21
    Several fixes and updates
  • Version cwlr-0.1.zip posted on 2006-02-21

Program Details