Spiders and Scrapers

("Spidering hacks" definitions)

* Spiders (or bots) automatically retrieve data from the web. They are usually more intelligent than teleporters and they usually download full pages.

* Scrapers grab very specific bits of information within these pages.

There are many ready-made bots around the Web. We'll learn to create some.