文章基本信息

标题：An Overview of Hadoop Scheduler Algorithms
本地全文：下载
作者：Faten Hamad
期刊名称：Modern Applied Science
印刷版ISSN：1913-1844
电子版ISSN：1913-1852
出版年度：2018
卷号：12
期号：8
页码：69-80
DOI：10.5539/mas.v12n8p69
语种：English
出版社：Canadian Center of Science and Education
摘要：Hadoop is a cloud computing open source system, used in large-scale data processing. It became the basic computing platforms for many internet companies. With Hadoop platform users can develop the cloud computing application and then submit the task to the platform. Hadoop has a strong fault tolerance, and can easily increase the number of cluster nodes, using linear expansion of the cluster size, so that clusters can process larger datasets. However Hadoop has some shortcomings, especially in the actual use of the process of exposure to the MapReduce scheduler, which calls for more researches on Hadoop scheduling algorithms.This survey provides an overview of the default Hadoop scheduler algorithms and the problem they have. It also compare between five Hadoop framework scheduling algorithms in term of the default scheduler algorithm to be enhanced, the proposed scheduler algorithm, type of cluster applied either heterogeneous or homogeneous, methodology, and clusters classification based on performance evaluation. Finally, a new algorithm based on capacity scheduling and use of perspective resource utilization to enhance Hadoop scheduling is proposed.