Exploring Deep Registration Latent Spaces
Not on the map. Why?
Abstract (arXiv)
Explainability of deep neural networks is one of the most challenging and interesting problems in the field. In this study, we investigate the topic focusing on the interpretability of deep learning-based registration methods. In particular, with the appropriate model architecture and using a simple linear projection, we decompose the encoding space, generating a new basis, and we empirically show that this basis captures various decomposed anatomically aware geometrical transformations. We perform experiments using two different datasets focusing on lungs and hippocampus MRI. We show that such an approach can decompose the highly convoluted latent spaces of registration pipelines in an orthogonal space with several interesting properties. We hope that this work could shed some light on a better understanding of deep learning-based registration methods.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 22 of its 29 references that are in the map. First posted on arXiv 23 Jul 2021.
Builds on
22 of 29 references.
References · 22
- 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,690
- 2013Auto-Encoding Variational Bayescited by 3,980
- 2015Learning Deep Features for Discriminative Localizationcited by 2,430
- 20163D U-Net: Learning Dense Volumetric Segmentation from Sparse Annotationcited by 1,471
- 2015Spatial Transformer Networkscited by 1,423
- 2014Striving for Simplicity: The All Convolutional Netcited by 983
- 2017Grad-CAM++: Improved Visual Explanations for Deep Convolutional Networkscited by 936
- 2016InfoGAN: Interpretable Representation Learning by Information Maximizing Generative Adversarial Netscited by 858
- 2018VoxelMorph: A Learning Framework for Deformable Medical Image Registrationcited by 657
- 2017Interpretable Explanations of Black Boxes by Meaningful Perturbationcited by 611
- 2019A large annotated medical image dataset for the development and evaluation of segmentation algorithmscited by 371
- 2019Causality matters in medical imagingcited by 193
10 more
- 2018Unsupervised Learning for Fast Probabilistic Diffeomorphic Registrationcited by 116
- 2020Fast Symmetric Diffeomorphic Image Registration with Convolutional Neural Networkscited by 107
- 2018Learning a Probabilistic Model for Diffeomorphic Registrationcited by 62
- 2018Deforming Autoencoders: Unsupervised Disentangling of Shape and Appearancecited by 58
- 2019Unsupervised Deformable Registration for Multi-Modal Images via Disentangled Representationscited by 52
- 2019Closing the Gap between Deep and Conventional Image Registration using Probabilistic Dense Displacement Networkscited by 40
- 2019Lifting AutoEncoders: Unsupervised Learning of a Fully-Disentangled 3D Morphable Model using Deep Non-Rigid Structure from Motioncited by 23
- 2018FAIM -- A ConvNet Method for Unsupervised 3D Medical Image Registrationcited by 19
- 2018Linear and Deformable Image Registration with 3D Convolutional Neural Networkscited by 8
- 2020Deep learning based registration using spatial gradients and noisy segmentation labelscited by 7
Built on by
Not cited yet.