EDMAE: An Efficient Decoupled Masked Autoencoder for Standard View Identification in Pediatric Echocardiography
Not on the map. Why?
Abstract (arXiv)
This paper introduces the Efficient Decoupled Masked Autoencoder (EDMAE), a novel self-supervised method for recognizing standard views in pediatric echocardiography. EDMAE introduces a new proxy task based on the encoder-decoder structure. The EDMAE encoder is composed of a teacher and a student encoder. The teacher encoder extracts the potential representation of the masked image blocks, while the student encoder extracts the potential representation of the visible image blocks. The loss is calculated between the feature maps output by the two encoders to ensure consistency in the latent representations they extract. EDMAE uses pure convolution operations instead of the ViT structure in the MAE encoder. This improves training efficiency and convergence speed. EDMAE is pre-trained on a large-scale private dataset of pediatric echocardiography using self-supervised learning, and then fine-tuned for standard view recognition. The proposed method achieves high classification accuracy in 27 standard views of pediatric echocardiography. To further verify the effectiveness of the proposed method, the authors perform another downstream task of cardiac ultrasound segmentation on the public dataset CAMUS. The experimental results demonstrate that the proposed method outperforms some popular supervised and recent self-supervised methods, and is more competitive on different downstream tasks.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 30 of its 49 references that are in the map. First posted on arXiv 27 Feb 2023.
Builds on
30 of 49 references.
References · 30
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
- 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,482
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
- 2016Densely Connected Convolutional Networkscited by 6,691
- 2022Generative Adversarial Networkscited by 5,603
- 2014Fully Convolutional Networks for Semantic Segmentationcited by 4,845
- 2018Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentationcited by 3,210
- 2016Pyramid Scene Parsing Networkcited by 2,472
18 more
- 2021BEiT: BERT Pre-Training of Image Transformerscited by 2,360
- 2020Improved Baselines with Momentum Contrastive Learningcited by 2,282
- 2019Searching for MobileNetV3cited by 1,984
- 2017Decoupled Weight Decay Regularizationcited by 1,722
- 2021TransUNet: Transformers Make Strong Encoders for Medical Image Segmentationcited by 1,552
- 2021SimMIM: A Simple Framework for Masked Image Modelingcited by 1,147
- 2019Segmentation Transformer: Object-Contextual Representations for Semantic Segmentationcited by 573
- 2020A Survey on Contrastive Self-supervised Learningcited by 553
- 2022Context Autoencoder for Self-Supervised Representation Learningcited by 297
- 2019Deep Learning for Segmentation using an Open Large-Scale Dataset in 2D Echocardiographycited by 243
- 2022ConvMAE: Masked Convolution Meets Masked Autoencoderscited by 105
- 2022Multi-Modal Masked Autoencoders for Medical Vision-and-Language Pre-Trainingcited by 104
- 2022Delving into Masked Autoencoders for Multi-Label Thorax Disease Classificationcited by 65
- 2022Self-supervised 3D anatomy segmentation using self-distilled masked image transformer (SMIT)cited by 35
- 2022Swin MAE: Masked Autoencoders for Small Datasetscited by 17
- 2022Contextual Representation Learning beyond Masked Language Modelingcited by 16
- 2022Unsupervised Anomaly Detection in Medical Images with a Memory-augmented Multi-level Cross-attentional Masked Autoencodercited by 15
- 2022Global Contrast Masked Autoencoders Are Powerful Pathological Representation Learnerscited by 11
Built on by
Citing papers per year: 2023: 2; 2024: 2.
4 papers.
- 2023Medical supervised masked autoencoders: Crafting a better masking strategy and efficient fine-tuning schedule for medical image classificationcited by 2
- 2023Reconstruction of Cardiac Cine MRI Using Motion-Guided Deformable Alignment and Multi-Resolution Fusioncited by 1
- 2024MambaEviScrib: Mamba and Evidence-Guided Consistency Enhance CNN Robustness for Scribble-Based Weakly Supervised Ultrasound Image Segmentationcited by 1
- 2024A Semi-Supervised Approach with Error Reflection for Echocardiography Segmentationcited by 0
- 2024A Semi-Supervised Approach with Error Reflection for Echocardiography Segmentation1 Dec 2024
- 2024MambaEviScrib: Mamba and Evidence-Guided Consistency Enhance CNN Robustness for Scribble-Based Weakly Supervised Ultrasound Image Segmentation28 Sep 2024
- 2023Medical supervised masked autoencoders: Crafting a better masking strategy and efficient fine-tuning schedule for medical image classification10 May 2023
- 2023Reconstruction of Cardiac Cine MRI Using Motion-Guided Deformable Alignment and Multi-Resolution Fusion9 Mar 2023