A WebSpider or crawler is an automated program that follows links on websites and calls a WebRobot to handle the contents of each link. -A WebSpider or crawler is an automated program that follows links on websites and calls a WebRobot to handle the