Very simple single-thread crawler for web (http) written in perl. Supports links following rules and collections to grab information of visited pages (regexp based).
VERSION HISTORY
- Version cwlr-0.1.zip posted on 2006-02-21
Several fixes and updates - Version cwlr-0.1.zip posted on 2006-02-21
Program Details
- Category: Network & Internet > Other
- Publisher: cwlr.sf.net
- License: Free
- Price: N/A
- Version: 0.1
- Platform: windows