Residual connections · MAAI7602 Applied Computer Vision

A residual block adds its input to the output of a few layers, y = F(x) + x. Keeping the input becomes easy, which makes very deep networks trainable. Why did deeper plain networks train worse than shallower ones, and how do residual connections address this?

This page needs JavaScript for its explanations, activities and practice questions.