mlsanityData to 7 Oct 2026

Unsupervised Multimodal Surface Registration with Geometric Deep Learning

arXiv 2311.13022 ↗First posted 21 Nov 2023cs.LG cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

This paper introduces GeoMorph, a novel geometric deep-learning framework designed for image registration of cortical surfaces. The registration process consists of two main steps. First, independent feature extraction is performed on each input surface using graph convolutions, generating low-dimensional feature representations that capture important cortical surface characteristics. Subsequently, features are registered in a deep-discrete manner to optimize the overlap of common structures across surfaces by learning displacements of a set of control points. To ensure smooth and biologically plausible deformations, we implement regularization through a deep conditional random field implemented with a recurrent neural network. Experimental results demonstrate that GeoMorph surpasses existing deep-learning methods by achieving improved alignment with smoother deformations. Furthermore, GeoMorph exhibits competitive performance compared to classical frameworks. Such versatility and robustness suggest strong potential for various neuroscience applications.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 27 of its 69 references that are in the map. First posted on arXiv 21 Nov 2023.

Builds on

27 of 69 references.

References · 27

  1. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  2. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  3. 2017Graph Attention Networkscited by 8,854
  4. 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,223
  5. 2019Fast Graph Representation Learning with PyTorch Geometriccited by 2,414
  6. 2016Convolutional Neural Networks on Graphs with Fast Localized Spectral Filteringcited by 2,085
  7. 2016Geometric deep learning: going beyond Euclidean datacited by 1,042
  8. 2018VoxelMorph: A Learning Framework for Deformable Medical Image Registrationcited by 657
  9. 2020SE(3)-Transformers: 3D Roto-Translation Equivariant Attention Networkscited by 602
  10. 2016Geometric deep learning on graphs and manifolds using mixture model CNNscited by 468
  11. 2018Spherical CNNscited by 452
  12. 2019Deep Closest Point: Learning Representations for Point Cloud Registrationcited by 318
15 more
  1. 2019PointNetLK: Robust & Efficient Point Cloud Registration using PointNetcited by 231
  2. 2015Conditional Random Fields as Recurrent Neural Networkscited by 213
  3. 2018A Deep Learning Framework for Unsupervised Affine and Deformable Image Registrationcited by 160
  4. 2018Unsupervised Learning for Fast Probabilistic Diffeomorphic Registrationcited by 116
  5. 2019Learning Conditional Deformable Templates with Convolutional Networkscited by 64
  6. 2020CoMIR: Contrastive Multimodal Image Representation for Registrationcited by 45
  7. 2020CNNs on Surfaces using Rotation-Equivariant Featurescited by 42
  8. 2019Closing the Gap between Deep and Conventional Image Registration using Probabilistic Dense Displacement Networkscited by 40
  9. 2019Spherical U-Net on Cortical Surfaces: Methods and Applicationscited by 34
  10. 2022Surface Vision Transformers: Attention-Based Modelling applied to Cortical Analysiscited by 25
  11. 2022Aligning individual brains with Fused Unbalanced Gromov-Wassersteincited by 23
  12. 2020Cortical surface registration using unsupervised learningcited by 12
  13. 2020ProsRegNet: A Deep Learning Framework for Registration of MRI and Histopathology Images of the Prostatecited by 11
  14. 2022A Deep-Discrete Learning Framework for Spherical Surface Registrationcited by 7
  15. 2023SUGAR: Spherical Ultrafast Graph Attention Framework for Cortical Surface Registrationcited by 4

Built on by

Not cited yet.