Gradient descent and backpropagation · MAAI7602 Applied Computer Vision

Training changes each parameter a little in the direction that lowers the loss. Backpropagation uses the chain rule to find that direction for every parameter at once. How does gradient descent update the parameters of a network, and how does backpropagation compute the required gradients?

This page needs JavaScript for its explanations, activities and practice questions.