SpectralFormer: Rethinking Hyperspectral Image Classification with Transformers

🤖 Plain-English Summary

Hyperspectral (HS) images are characterized by approximately contiguous spectral information, enabling the fine identification of materials by capturing subtle spectral discrepancies. We evaluate the classification performance of the proposed SpectralFormer on three HS datasets by conducting extensive experiments, showing the superiority over classic transformers and achieving a significant improvement in comparison with advanced backbone networks.

🔑 Key Findings

• Owing to their excellent locally contextual modeling ability, convolutional neural networks (CNNs) have been proven to be a powerful feature extractor in HS image classification.
• However, CNNs fail to mine and represent the sequence attributes of spectral signatures well due to the limitations of their inherent network backbone.
• To solve this issue, we rethink HS image classification from a sequential perspective with transformers, and propose a novel backbone network called \ul{SpectralFormer}.

🔗 Related Resources