Spider

The search engine ‘crawler’ or ‘spider’ which scans your website pages in order to index it. An example of a spider is a Googlebot, Bingbot etc.