The projection head: h and z · MAAI7602 Applied Computer Vision

SimCLR computes its loss on z = g(h), the output of a small projection head on top of the encoder features h. After pretraining, the head is discarded and h is used. Why does SimCLR compute its loss on one vector and keep a different one?

This page needs JavaScript for its explanations, activities and practice questions.