Yep. Googlebot is a crawler/spider.
Type: Posts; User: RimfireNZ
Yep. Googlebot is a crawler/spider.
A spider (or "crawler") is a script that is most commonly used by search engines to "crawl" through websites, indexing (or saving) every page and following through links on the page etc.
It...