Glossary Crawling By Pawan Sharma - February 21, 2018 0 742 Crawling is what a search engine bot does when it reads the code of a website’s page. Once a web page is ‘crawled’, the information is kept in a massive index that is then used to bring up search engine results.