Publisher review:Site Index will spider website and extract all anchor links from all webpages. Site Index will spider website and extract all anchor links from all webpages. It can also extract titles and plain text.
URL Reduction
You might be astonished at how many ways there are to refer to the same location on the web. Here are just a few examples:
- http://www.domain.com/path/index.html
- http://www.domain.com/path/
- http://www.domain.com/path
- http://domain.com/path/index.html
The script will reduce such URLs to the same form so that only one link per webpage is indexed. It will optionally auto-append or strip www. prefix from domain name and auto-append or strip default filename index.* from url.
Query Strings
If you store session ids or some other random values in the query string the script will optionally remove them.
Site Index is a PHP script for Link Indexing scripts design by Ilya S. Lyubinskiy.
It runs on following operating system: Windows / Linux / Mac OS / BSD / Solaris.
Operating system:Windows / Linux / Mac OS / BSD / Solaris
Site Index script details 
