Batch normalisation · MAAI7602 Applied Computer Vision

Batch normalisation rescales each channel to zero mean and unit variance using statistics of the current batch, then applies a learned scale and offset. At evaluation it uses stored running statistics instead. What does batch normalisation compute, and why does it behave differently in training and evaluation mode?

This page needs JavaScript for its explanations, activities and practice questions.