n. (Computers, Internet) program used to search through the Internet for documents that include a specific subject or word/phrase and downloads their contents in an automatic manner for indexing
WEB CRAWLER
Meaning of WEB CRAWLER in English
Explanatory English dictionary bed edition. Толковый словарь английского языка Редакция bed. 2012