mlsanityData to 14 Oct 2026

SAME++: A Self-supervised Anatomical eMbeddings Enhanced medical image registration framework using stable sampling and regularized transformation

arXiv 2311.14986 ↗First posted 25 Nov 2023cs.CVcited by 9

Not on the map. Why?

Abstract (arXiv)

Image registration is a fundamental medical image analysis task. Ideally, registration should focus on aligning semantically corresponding voxels, i.e., the same anatomical locations. However, existing methods often optimize similarity measures computed directly on intensities or on hand-crafted features, which lack anatomical semantic information. These similarity measures may lead to sub-optimal solutions where large deformations, complex anatomical differences, or cross-modality imagery exist. In this work, we introduce a fast and accurate method for unsupervised 3D medical image registration building on top of a Self-supervised Anatomical eMbedding (SAM) algorithm, which is capable of computing dense anatomical correspondences between two images at the voxel level. We name our approach SAM-Enhanced registration (SAME++), which decomposes image registration into four steps: affine transformation, coarse deformation, deep non-parametric transformation, and instance optimization. Using SAM embeddings, we enhance these steps by finding more coherent correspondence and providing features with better semantic guidance. We extensively evaluated SAME++ using more than 50 labeled organs on three challenging inter-subject registration tasks of different body parts. As a complete registration framework, SAME++ markedly outperforms leading methods by 4.2% - 8.2% in terms of Dice score while being orders of magnitude faster than numerical optimization-based methods. Code is available at urlhttps://github.com/alibaba-damo-academy/same.

Key facts. Cited by 9 papers in the map (data through 14 Oct 2026). Builds on 29 of its 63 references that are in the map. First posted on arXiv 25 Nov 2023.

Builds on

29 of 63 references.

References · 29

  1. 20163D U-Net: Learning Dense Volumetric Segmentation from Sparse Annotationcited by 1,476
  2. 2018VoxelMorph: A Learning Framework for Deformable Medical Image Registrationcited by 662
  3. 2019Self-supervised Visual Feature Learning with Deep Neural Networks: A Surveycited by 657
  4. 2020Dense Contrastive Learning for Self-Supervised Visual Pre-Trainingcited by 512
  5. 2019Unsupervised Learning of Probabilistic Diffeomorphic Registration for Images and Surfacescited by 186
  6. 2020Unsupervised Learning of Dense Visual Representationscited by 147
  7. 2020Large Deformation Diffeomorphic Image Registration with Laplacian Pyramid Networkscited by 136
  8. 2021Learn2Reg: comprehensive multi-task medical image registration challenge, dataset and evaluation in the era of deep learningcited by 125
  9. 2018Unsupervised Learning for Fast Probabilistic Diffeomorphic Registrationcited by 116
  10. 2017Quicksilver: Fast Predictive Image Registration - a Deep Learning Approachcited by 113
  11. 2015Learning to Compare Image Patches via Convolutional Neural Networkscited by 109
  12. 2020Fast Symmetric Diffeomorphic Image Registration with Convolutional Neural Networkscited by 107
17 more
  1. 2016Universal Correspondence Networkcited by 82
  2. 2020SAM: Self-supervised Learning of Pixel-wise Anatomical Embeddings in Radiological Imagescited by 67
  3. 2019DeepAtlas: Joint Semi-Supervised Learning of Image Registration and Segmentationcited by 66
  4. 2019Unsupervised 3D End-to-End Medical Image Registration with Volume Tweening Networkcited by 62
  5. 2019Networks for Joint Affine and Non-parametric Image Registrationcited by 44
  6. 2022textttGradICON: Approximate Diffeomorphisms via Gradient Inverse Consistencycited by 41
  7. 2021Fast 3D registration with accurate optimisation and little learning for Learn2Reg 2021cited by 40
  8. 2022Affine Medical Image Registration with Coarse-to-Fine Vision Transformercited by 35
  9. 2017Image Matching Using SIFT, SURF, BRIEF and ORB: Performance Comparison for Distorted Imagescited by 30
  10. 2014Do Convnets Learn Correspondence?cited by 28
  11. 2021ICON: Learning Regular Maps Through Inverse Consistencycited by 26
  12. 2020Deep Lesion Tracker: Monitoring Lesions in 4D Longitudinal Imaging Studiescited by 25
  13. 2021SAME: Deformable Image Registration based on Self-supervised Anatomical Embeddingscited by 21
  14. 2020Learning Deformable Image Registration from Optimization: Perspective, Modules, Bilevel Training and Beyondcited by 19
  15. 2021DeepStationing: Thoracic Lymph Node Station Parsing in CT Scans using Anatomical Context Encoding and Key Organ Auto-Searchcited by 9
  16. 2022Automated Learning for Deformable Medical Image Registration by Jointly Optimizing Network Architectures and Objective Functionscited by 8
  17. 2021Comprehensive and Clinically Accurate Head and Neck Organs at Risk Delineation via Stratified Deep Learning: A Large-scale Multi-Institutional Studycited by 1

Built on by

Cited by year

Citing papers per year: 2024: 5; 2025: 4.

9 papers.