Spider Bot
A spider or bot is a customizable computer program that crawls around the Web indexing Web pages and or links in those pages. Also called a crawler.
The spider indexes specific information from each web page that it visits.
Many web sites get listed in the search engines when spiders visit their sites and index them to their web catalog. An example of an industrial strength spider is Google’s Googlebot. AltaVista’s spider is called Scooter.
|