文章基本信息

标题：IMPROVEMENTS OF BACK PROPAGATION ALGORITHM PERFORMANCE BY ADAPTIVELY CHANGING GAIN, MOMENTUM AND LEARNING RATE
本地全文：下载
作者：Norhamreeza Abdul Hamid ; Nazri Mohd Nawi ; Rozaida Ghazali 等
期刊名称：International Journal of New Computer Architectures and their Applications
印刷版ISSN：2220-9085
出版年度：2011
卷号：1
期号：4
页码：866-878
出版社：Society of Digital Information and Wireless Communications
摘要：In some practical Neural Network (NN) applications, fast response to external events within enormously short time is highly demanded. However, by using back propagation (BP) based on gradient descent optimisation method obviously not satisfy in several application due to serious problems associated with BP which are slow learning convergence velocity and confinement to shallow minima. Over the years, many improvements and modifications of the BP learning algorithm have been reported. In this research, we modified existing BP learning algorithm with adaptive gain by adaptively change the momentum coefficient and learning rate. In learning the patterns, the simulation results indicate that the proposed algorithm can hasten up the convergence behaviour as well as slide the network through shallow local minima compare to conventional BP algorithm. We use five common benchmark classification problems to illustrate the improvement of the proposed algorithm.
关键词：Back propagation; convergence speed; shallow minima; adaptive gain; adaptive momentum; adaptive learning rate