-
Weight Update Rule: This equation is updating the weight based on its previous value and the change in weight. - is the weight of the connection from input unit to the neural network at time . - is the current iteration or time step. - is the change in the weight at time .
-
Change in Weight ( ): - is the change in weight at time . - is the learning rate, controlling the size of the weight updates. - is the negative gradient of the error () with respect to the weight . - This term indicates the direction and magnitude of the change needed to minimize the error.
-
Gradient Calculation: - is the gradient of the error with respect to the weight . - is the target output, is the actual output, and is the error. - is the derivative of the activation function with respect to the net input to the output unit. - is the input from unit for pattern .