Bayesian Unsupervised Disentanglement of Anatomy and Geometry for Deep Groupwise Image Registration
Not on the map. Why?
Abstract (arXiv)
This article presents a general Bayesian learning framework for multi-modal groupwise image registration. The method builds on probabilistic modelling of the image generative process, where the underlying common anatomy and geometric variations of the observed images are explicitly disentangled as latent variables. Therefore, groupwise image registration is achieved via hierarchical Bayesian inference. We propose a novel hierarchical variational auto-encoding architecture to realise the inference procedure of the latent variables, where the registration parameters can be explicitly estimated in a mathematically interpretable fashion. Remarkably, this new paradigm learns groupwise image registration in an unsupervised closed-loop self-reconstruction process, sparing the burden of designing complex image-based similarity measures. The computationally efficient disentangled network architecture is also inherently scalable and flexible, allowing for groupwise registration on large-scale image groups with variable sizes. Furthermore, the inferred structural representations from multi-modal images via disentanglement learning are capable of capturing the latent anatomy of the observations with visual semantics. Extensive experiments were conducted to validate the proposed framework, including four different datasets from cardiac, brain, and abdominal medical images. The results have demonstrated the superiority of our method over conventional similarity-based approaches in terms of accuracy, efficiency, scalability, and interpretability.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 67 of its 149 references that are in the map. First posted on arXiv 4 Jan 2024.
Builds on
67 of 149 references.
References · 67
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2016Categorical Reparameterization with Gumbel-Softmaxcited by 2,708
- 2019Explainable Artificial Intelligence (XAI): Concepts, Taxonomies, Opportunities and Challenges toward Responsible AIcited by 1,543
- 2018Attention U-Net: Learning Where to Look for the Pancreascited by 1,420
- 2016The Concrete Distribution: A Continuous Relaxation of Discrete Random Variablescited by 1,135
- 2017Multimodal Machine Learning: A Survey and Taxonomycited by 1,004
- 2018Challenging Common Assumptions in the Unsupervised Learning of Disentangled Representationscited by 929
- 2016Deep Variational Information Bottleneckcited by 915
- 2016Pixel Recurrent Neural Networkscited by 814
- 2018Multimodal Unsupervised Image-to-Image Translationcited by 795
- 2018VoxelMorph: A Learning Framework for Deformable Medical Image Registrationcited by 657
38 more
- 2021The RSNA-ASNR-MICCAI BraTS 2021 Benchmark on Brain Tumor Segmentation and Radiogenomic Classificationcited by 507
- 2019Variational Autoencoders and Nonlinear ICA: A Unifying Frameworkcited by 494
- 2019A Survey on Explainable Artificial Intelligence (XAI): Towards Medical XAIcited by 403
- 2020CHAOS Challenge -- Combined (CT-MR) Healthy Abdominal Organ Segmentationcited by 307
- 2018Towards a Definition of Disentangled Representationscited by 294
- 2020A Survey on Neural Network Interpretabilitycited by 291
- 2017VAE with a VampPriorcited by 247
- 2017Variational Inference of Disentangled Latent Concepts from Unlabeled Observationscited by 240
- 2017Emergence of Invariance and Disentanglement in Deep Representationscited by 213
- 2018Multimodal Generative Models for Scalable Weakly-Supervised Learningcited by 200
- 2019Domain-Specific Batch Normalization for Unsupervised Domain Adaptationcited by 197
- 2019Unsupervised Learning of Probabilistic Diffeomorphic Registration for Images and Surfacescited by 186
- 2019Variational Mixture-of-Experts Autoencoders for Multi-Modal Deep Generative Modelscited by 177
- 2018A Deep Learning Framework for Unsupervised Affine and Deformable Image Registrationcited by 160
- 2019Practical Deep Learning with Bayesian Principlescited by 158
- 2016Multivariate mixture model for myocardium segmentation combining multi-source imagescited by 133
- 2021Learn2Reg: comprehensive multi-task medical image registration challenge, dataset and evaluation in the era of deep learningcited by 125
- 2016HeMIS: Hetero-Modal Image Segmentationcited by 102
- 2018Learning Deep Disentangled Embeddings with the F-Statistic Losscited by 101
- 2018Weakly-Supervised Convolutional Neural Networks for Multimodal Image Registrationcited by 90
- 2021Generalized Multimodal ELBOcited by 86
- 2021HyperMorph: Amortized Hyperparameter Learning for Image Registrationcited by 84
- 2021A Review of the Gumbel-max Trick and its Extensions for Discrete Stochasticity in Machine Learningcited by 82
- 2019Disentangled Representation Learning in Cardiac Image Analysiscited by 69
- 2019Hetero-Modal Variational Encoder-Decoder for Joint Modality Completion and Segmentationcited by 68
- 2019Learning Conditional Deformable Templates with Convolutional Networkscited by 64
- 2018Structured Disentangled Representationscited by 62
- 2018Deforming Autoencoders: Unsupervised Disentangling of Shape and Appearancecited by 58
- 2019Unsupervised Deformable Registration for Multi-Modal Images via Disentangled Representationscited by 52
- 2019Dual-Stream Pyramid Registration Networkcited by 52
- 2018Counterfactuals uncover the modular structure of deep generative modelscited by 51
- 2023CTVIS: Consistent Training for Online Video Instance Segmentationcited by 50
- 2020CoMIR: Contrastive Multimodal Image Representation for Registrationcited by 45
- 2023BayeSeg: Bayesian Modeling for Medical Image Segmentation with Interpretable Generalizabilitycited by 42
- 2020Cardiac Segmentation on Late Gadolinium Enhancement MRI: A Benchmark Study from Multi-Sequence Cardiac MR Segmentation Challengecited by 41
- 2021Fast 3D registration with accurate optimisation and little learning for Learn2Reg 2021cited by 40
- 2020Rao-Blackwellizing the Straight-Through Gumbel-Softmax Gradient Estimatorcited by 37
- 2021On the Limitations of Multimodal VAEscited by 37
50 most cited of 67 All 67 (JSON)
Built on by
Citing papers per year: 2025: 1.
1 paper.