Crawl

The first pipeline stage: a crawler discovers and fetches a page. A page that can’t be crawled can’t rank.

First used in: 0.2 · How search engines work