DS-TransUNet: Dual Swin Transformer U-Net for Medical Image Segmentation

🤖 Plain-English Summary

Automatic medical image segmentation has made great progress owing to the powerful deep representation learning. Additionally, we introduce the Swin Transformer block into decoder to further explore the long-range contextual information during the up-sampling process.

🔑 Key Findings

• Inspired by the success of self-attention mechanism in Transformer, considerable efforts are devoted to designing the robust variants of encoder-decoder architecture with Transformer.
• However, the patch division used in the existing Transformer-based models usually ignores the pixel-level intrinsic structural features inside each patch.
• In this paper, we propose a novel deep medical image segmentation framework called Dual Swin Transformer U-Net (DS-TransUNet), which aims to incorporate the hierarchical Swin Transformer into both encoder and decoder of the standard U-shaped architecture.

🔗 Related Resources