- 1,251 categories
- 40,829 scripts
Updated: 07/08/2005
- MASTER RESELL RIGHTS FOR THIS SCRIPT AND OVER 100 MORE INCLUDED IN THE PRICE!!!
URL SPIDER AND DOMAIN EXTRACTOR SCRIPT
You are going to love this script! A simple, yet powerful cgi script with mysql database interface that will allow you to spider the internet and collect unique urls and domain names at the speed of light!
5 minutes to configure, set your starting url and the spider will start probing the internet from the starting url collecting every single link and unique domain name it finds along the way. A great way to construct targeted marketing databases or start your own search engine.
Script allows you to select spidering depth or just leave it until your hard drive explodes with data. This script is a masterpiece.
- Categories
- Platforms
- Licenses
- Author