| |
ArchitextSpider
The ArchitextSpider is a web crawler robot that collects information for the Excite and WebCrawler search engines. Its two main purposes are to discover and index resources on the web (web sites, pages, content etc.) and to generate statistics.
|
|