文章基本信息

标题：A Review of Web Crawler Algorithms
本地全文：下载
作者：Apoorv Vikram Singh ; Vikas ; Achyut Mishra 等
期刊名称：International Journal of Computer Science and Information Technologies
电子版ISSN：0975-9646
出版年度：2014
卷号：5
期号：5
页码：6689-6691
出版社：TechScience Publications
摘要：The web today contains a lot of information and it keeps on increasing everyday. Thus, due to the availability of abundant data on web, searching for some particular data in this collection has become very difficult. Emphasis is given to the relevance and robustness of data by the on-going researches. Although only relevant pages are to be considered for any search query but still huge data needs to be explored. Another important thing to keep in mind is that usually one’s need may not be desirable for others. Crawling algorithms are thus crucial in selecting the pages that satisfy the user’s need. This paper reviews the researches on web crawling algorithms used for searching.
关键词：Web Crawling Algorithms; Crawling Algorithm;Survey; Search Algorithms