Attention and vision transformers · MAAI7602 Applied Computer Vision

A vision transformer cuts an image into patches and turns each into a token. Self-attention lets every token combine information from every other token, with weights computed from the content. How does a vision transformer process an image, and what does one self-attention step compute?

This page needs JavaScript for its explanations, activities and practice questions.