Spiders are programs sent out by search engines to automatically look for new or updated content on the Internet. The spiders then feed the search engines with the new information and we get more visitors as a result. The spiders are called spiders because they crawl over the web, but they are also sometimes calle webcrawlers or bots (robots)