What is a search engine crawler?

A.
A program that automatically searches the Web for new sites and indexes all of its pages.

B.
A database that stores the URLs stored into a hierarchical category structure.

C.
A program that searches the Web for pages containing the keyword specified by the user.

D.
The code that sends information to the third-party server for recording traffic data.