Search engines normally consist of a crawler (also known as a spider or bot) that traverse a document collection.
The crawler deconstructs document text and assigns surrogates for storage in the search engine index.
Online search engines store images, link data and metadata for the document as well.