Search Engine Spider

Also known as a Web crawler or bot
An automated program which scans websites to provide information to search engines often for the purpose of indexing (ranking) websites.