SCConv: Spatial and Channel Reconstruction Convolution for Feature Redundancy

🤖 Plain-English Summary

Convolutional Neural Networks (CNNs) have achieved remarkable performance in various computer vision tasks but this comes at the cost of tremendous computational resources, partly due to convolutional layers extracting redundant features. In addition, SCConv is a plug-and-play architectural unit that can be used to replace standard convolution in various convolutional neural networks directly.

🔑 Key Findings

• Recent works either compress well-trained large-scale models or explore well-designed lightweight models.
• In this paper, we make an attempt to exploit spatial and channel redundancy among features for CNN compression and propose an efficient convolution module, called SCConv (Spatial and Channel reconstruction Convolution), to decrease redundant computing and facilitate representative feature learning.
• The proposed SCConv consists of two units: spatial reconstruction unit (SRU) and channel reconstruction unit (CRU).

🔗 Related Resources