Professional Documents
Culture Documents
M. U. Kale Assistant Professor Department of Irrigation & Drainage Engineering, Dr. P. D. K.V., Akola
technology. Advantages over conventional modeling ability to handle large amounts of noisy data from dynamic and nonlinear systems, especially when the underlying physical relationships are not fully understood.
The multi-layer perceptron (MLP) ANN is most widely used type of ANN in hydrological modelling (Wang et al. 2006).
An Artificial Neural Network (ANN) is an information processing paradigm that is inspired by the way biological nervous system, such as brain, process information. An ANN is an adaptive, most often non-linear system that learns to perform a function (an input/output map) from data. A Computing system made of a number of simple, highly interconnected processing elements, which process information by their dynamic state response to external input.
given by R.Hecht-Nielsen (1989)
Input Layer Weight Matrix Hidden Layer Weight Matrix Output Layer
Output Values
Number of hidden layers Number of nodes in hidden layers Selection of Training Algorithm Selection of Activation Function Selection of Stopping Criteria Selection of Input Parameters
The ANN training - non-linear optimization. The aim of supervised learning is to determine a set of weights, which minimizes the error. Thats why a training algorithm is needed to solve a neural network problem. Algorithms available for training a network : Variable learning rate and momentum (BPvm), Resilient Back Propagation (RBP), Polak-Ribiere etc. Selection of an algorithm that provides the best fit to the data is required. Among various algorithms reported in literature Levenberg-Marquardt (L-M) algorithm is much more robust and outperformed other algorithms in terms of accuracy and convergence speed (Vos and Rientjes, 2005). Levenberg-Marquardt algorithm is a quasi-Newton method that proved to be quickest and was less easily trapped in local minima (Brath et al., 2002). Levenberg-Marquardt (L-M) algorithm should be used for modeling application for prediction of inflow to the reservoir.
Activation functions are needed for introducing non linearity into the network and it is non linearity that makes multilayer networks so powerful. Various transfer functions reported in literature are
sigmoidal types (logistic and hyperbolic tangent function), hard limit transfer functions (bounded to 0 or 1), linear, polynomial, rational function (ratios of polynomial) and fourier series (sum of cosines)
In literature, most commonly used transfer functions for rainfallrunoff (R-R) modeling are sigmoidal type transfer functions in the hidden layers and linear transfer functions in the output layer due to its advantage in extrapolation beyond the range of the training data (Hsu et al., 1995; Maier and Dandy, 2000; Zealand et al., 1999; Calvoa and Portelab, 2007).
Conclusions
On the basis of above discussion it is suggested to adopt following parameters while building up ANN structure/model for prediction of inflow to the reservoir using MLP ANN technique, for accurate results. i) A single hidden layer network. ii) The trial and error method for determining optimum number of neurons in hidden layer. iii) Levenberg-Marquardt algorithm as a training algorithm iv) Sigmoidal type transfer function in input hidden layer and linear transfer function in output layer. v) An early stopping criterion for stopping of training. vi) Previous runoff/inflow to reservoir along with rainfall values as input parameters.
Thank You