Attention mechanisms in computer vision: A survey

🤖 Plain-English Summary

Humans can naturally and effectively find salient regions in complex scenes. In this survey, we provide a comprehensive review of various attention mechanisms in computer vision and categorize them according to approach, such as channel attention, spatial attention, temporal attention, and branch attention; a related repository https://github.com/MenghaoGuo/Awesome-Vision-Attentions is dedicated to collecting related work.

🔑 Key Findings

• Motivated by this observation, attention mechanisms were introduced into computer vision with the aim of imitating this aspect of the human visual system.
• Such an attention mechanism can be regarded as a dynamic weight adjustment process based on features of the input image.
• Attention mechanisms have achieved great success in many visual tasks, including image classification, object detection, semantic segmentation, video understanding, image generation, 3D vision, multimodal tasks, and self-supervised learning.

🔗 Related Resources