[Update] What is Crawler? Edit A web crawler or web spider is a script which surf World Wide Web in a regular manner. A web crawler is one type of bot, other names are web spider, web robot, bot, crawler, and automatic indexer. Share this post Related Posts[Update] What is Crawler?
