Efficient Multi-Scale Attention Module with Cross-Spatial Learning

🤖 Plain-English Summary

Remarkable effectiveness of the channel or spatial attention mechanisms for producing more discernible feature representation are illustrated in various computer vision tasks. Specifically, apart from encoding the global information to re-calibrate the channel-wise weight in each parallel branch, the output features of the two parallel branches are further aggregated by a cross-dimension interaction method.

🔑 Key Findings

• However, modeling the cross-channel relationships with channel dimensionality reduction may bring side effect in extracting deep visual representations.
• In this paper, a novel efficient multi-scale attention (EMA) module is proposed.
• Focusing on retaining the information on per channel and decreasing the computational overhead, EMA groups the channel dimensions into multiple sub-features and makes the spatial semantic features well-distributed inside each feature group.

🔗 Related Resources