Back propagation algorithm with adaptation learning rate and momentum method in neural network controller

Abstract

In recent years, Artificial Neural Network has been successfully used in many industrial applications such as signal processing, image identification, transport, medicine, control… Many neural network control schemes using Back Propagation algorithm have been used for a kind of plant with nonlinearity uncertainties and disturbances. And Gradient Descent is one of popular and simple algorithms for training of neural network. In order to ensure algorithm always converge and fast network training, two methods are used to improve network's performance - Adaptation Learning Rate and Momentum method. In this study, we will simulate, verify and compare those theories using MATLAB package.