Categories
CGI and PerlScripts and ProgramsSearching → Web Indexing

Harvest-NG

Harvest-NG is a collection of Perl modules and scripts which provide a powerful web crawling and summarizing agent. The code is aimed at providing an open source, standards compliant, tool for fetching content from a wide variety of information sourc...
  • Platforms
    • Linux
  • Licenses
    • Freeware
DETAILS

Internet Spy (i-spy)

I-Spy is a Perl script which identifies new files on various remote FTP and Web sites. It grabs and compares contents of FTP directories and web pages. It will then compile a report and either send it via e-mail or save it as a web page. You may also...
  • Platforms
    • Linux
  • Licenses
    • Freeware
DETAILS

WebAwk

This is a proof-of-concept of a tool to automate web browsing / data collection. It works like AWK except that instead of working on files and lines it works on HTML pages and hyperlinks. It is meant to be run as a command line script and includes ba...
  • Platforms
    • Linux
  • Licenses
    • Freeware
DETAILS

Web Secretary

Web Secretary is a web page monitoring software. However, it goes beyond the normal functionalities offered by such software. Not only does it detect changes based on content analysis (instead of date/time stamp or simple textual comparison), it will...
  • Platforms
    • Linux
  • Licenses
    • Freeware
DETAILS
©2019 A--9.com