Spiders

Up

Spiders, also known as crawlers, are robot programs that have a set of rules called algorithms which guide them as they look through documents on the Internet.  For example, some follow every link on every home page.  Other spiders ignore some items and look specifically for the most popular home pages.  Some spiders do not index PDF files, audio files, graphic files, etc., only HTML files.   Because each one is different, you do not get exactly the same results for the same search using different search engines.

• Home • Presentations •