文章基本信息

标题：Scalable Distributed Job Processing with Dynamic Load Balancing
本地全文：下载
作者：Srinivasrao Putti ; V P C Rao ; A. Govardhan 等
期刊名称：International Journal of Distributed and Parallel Systems
印刷版ISSN：2229-3957
电子版ISSN：0976-9757
出版年度：2013
卷号：4
期号：3
DOI：10.5121/ijdps.2013.4302
出版社：Academy & Industry Research Collaboration Center (AIRCC)
摘要：We present here a cost effective framework for a robust scalable and distributed job processing system that adapts to the dynamic computing needs easily with efficient load balancing for heterogeneous systems. The design is such that each of the components are self contained and do not depend on each other. Yet, they are still interconnected through an enterprise message bus so as to ensure safe, secure and reliable communication based on transactional features to avoid duplication as well as data loss. The load balancing, fault-tolerance and failover recovery are built into the system through a mechanism of health check facility and a queue based load balancing. The system has a centralized repository with central monitors to keep track of the progress of various job executions as well as status of processors in real-time. The basic requirement of assigning a priority and processing as per priority is built into the framework. The most important aspect of the framework is that it avoids the need for job migration by computing the target processors based on the current load and the various cost factors. The framework will have the capability to scale horizontally as well as vertically to achieve the required performance, thus effectively minimizing the total cost of ownership
关键词：Job Processing; Load Balancing; Monitoring; Distributed And Scalable