Crawl defined web sites and automatically creates a site map in a standard form.
Features:
- Auto-generates an XML site map for use with Google, Yahoo, Microsoft and any other search system that recognizes the XML standard.
- Auto-notifies Google when a new site map is generated.
- Follows the rules defined by a Robots.txt file located in the root of the site.
