Why is backpropagation called backwards propagation of error, when it back propagates error derivatives?

Question

Wikipedia says:

The backward propagation of errors or backpropagation, is a common method of training artificial neural networks and used in conjunction with an optimization method such as gradient descent.

Ultimately, backward propagation is used to get the partial derivates of the weights and biases of the network, so that gradient descent can be used.

This means you end up with $\frac{\partial TotalError}{\partial weight_i}$ and $\frac{\partial TotalError}{\partial bias_i}$ at the end, for all weights and biases, but you don't actualy end up with any sort of specific error value for the neurons.

With that in mind, why is it called back propagation of errors, instead of backpropagation of error gradient or something similar?

Answer 1

It's actually the error for the neurons. The actual reason for derivation is this:

• You find an error then you find the derivative of the error according to some differential equation.

• Gradients you obtain using that derivative is basically to determine how much one single neuron in the network made mistake. Gradient at one neuron means if you update the weights or biases according to that you decrease the error network makes.

Backpropagation is the mathematical system for assesing how much one neuron made mistake so you can improve it. Definition is true in that sense.