mlsanityData to 7 Oct 2026

EDMAE: An Efficient Decoupled Masked Autoencoder for Standard View Identification in Pediatric Echocardiography

arXiv 2302.13869 ↗First posted 27 Feb 2023eess.IV cs.CVcited by 4

Not on the map. Why?

Abstract (arXiv)

This paper introduces the Efficient Decoupled Masked Autoencoder (EDMAE), a novel self-supervised method for recognizing standard views in pediatric echocardiography. EDMAE introduces a new proxy task based on the encoder-decoder structure. The EDMAE encoder is composed of a teacher and a student encoder. The teacher encoder extracts the potential representation of the masked image blocks, while the student encoder extracts the potential representation of the visible image blocks. The loss is calculated between the feature maps output by the two encoders to ensure consistency in the latent representations they extract. EDMAE uses pure convolution operations instead of the ViT structure in the MAE encoder. This improves training efficiency and convergence speed. EDMAE is pre-trained on a large-scale private dataset of pediatric echocardiography using self-supervised learning, and then fine-tuned for standard view recognition. The proposed method achieves high classification accuracy in 27 standard views of pediatric echocardiography. To further verify the effectiveness of the proposed method, the authors perform another downstream task of cardiac ultrasound segmentation on the public dataset CAMUS. The experimental results demonstrate that the proposed method outperforms some popular supervised and recent self-supervised methods, and is more competitive on different downstream tasks.

Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 30 of its 49 references that are in the map. First posted on arXiv 27 Feb 2023.

Builds on

30 of 49 references.

References · 30

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  3. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  4. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
  5. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
  6. 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,482
  7. 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
  8. 2016Densely Connected Convolutional Networkscited by 6,691
  9. 2022Generative Adversarial Networkscited by 5,603
  10. 2014Fully Convolutional Networks for Semantic Segmentationcited by 4,845
  11. 2018Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentationcited by 3,210
  12. 2016Pyramid Scene Parsing Networkcited by 2,472
18 more
  1. 2021BEiT: BERT Pre-Training of Image Transformerscited by 2,360
  2. 2020Improved Baselines with Momentum Contrastive Learningcited by 2,282
  3. 2019Searching for MobileNetV3cited by 1,984
  4. 2017Decoupled Weight Decay Regularizationcited by 1,722
  5. 2021TransUNet: Transformers Make Strong Encoders for Medical Image Segmentationcited by 1,552
  6. 2021SimMIM: A Simple Framework for Masked Image Modelingcited by 1,147
  7. 2019Segmentation Transformer: Object-Contextual Representations for Semantic Segmentationcited by 573
  8. 2020A Survey on Contrastive Self-supervised Learningcited by 553
  9. 2022Context Autoencoder for Self-Supervised Representation Learningcited by 297
  10. 2019Deep Learning for Segmentation using an Open Large-Scale Dataset in 2D Echocardiographycited by 243
  11. 2022ConvMAE: Masked Convolution Meets Masked Autoencoderscited by 105
  12. 2022Multi-Modal Masked Autoencoders for Medical Vision-and-Language Pre-Trainingcited by 104
  13. 2022Delving into Masked Autoencoders for Multi-Label Thorax Disease Classificationcited by 65
  14. 2022Self-supervised 3D anatomy segmentation using self-distilled masked image transformer (SMIT)cited by 35
  15. 2022Swin MAE: Masked Autoencoders for Small Datasetscited by 17
  16. 2022Contextual Representation Learning beyond Masked Language Modelingcited by 16
  17. 2022Unsupervised Anomaly Detection in Medical Images with a Memory-augmented Multi-level Cross-attentional Masked Autoencodercited by 15
  18. 2022Global Contrast Masked Autoencoders Are Powerful Pathological Representation Learnerscited by 11

Built on by

Cited by year

Citing papers per year: 2023: 2; 2024: 2.

4 papers.