Learning Disentangled Representations in the Imaging Domain
Not on the map. Why?
Abstract (arXiv)
Disentangled representation learning has been proposed as an approach to learning general representations even in the absence of, or with limited, supervision. A good general representation can be fine-tuned for new target tasks using modest amounts of data, or used directly in unseen domains achieving remarkable performance in the corresponding task. This alleviation of the data and annotation requirements offers tantalising prospects for applications in computer vision and healthcare. In this tutorial paper, we motivate the need for disentangled representations, revisit key concepts, and describe practical building blocks and criteria for learning such representations. We survey applications in medical imaging emphasising choices made in exemplar key works, and then discuss links to computer vision applications. We conclude by presenting limitations, challenges, and opportunities.
Key facts. Cited by 46 papers in the map (data through 7 Oct 2026). Builds on 183 of its 286 references that are in the map. First posted on arXiv 26 Aug 2021.
Builds on
183 of 286 references.
References · 183
- 2017Attention Is All You Needcited by 59,932
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
- 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,482
- 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 6,979
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
- 2016Feature Pyramid Networks for Object Detectioncited by 5,021
- 2020Bootstrap your own latent: A new approach to self-supervised Learningcited by 4,712
- 2017Neural Discrete Representation Learningcited by 4,650
- 2016The Cityscapes Dataset for Semantic Urban Scene Understandingcited by 4,427
- 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,580
- 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,880
38 more
- 2016Categorical Reparameterization with Gumbel-Softmaxcited by 2,708
- 2016Perceptual Losses for Real-Time Style Transfer and Super-Resolutioncited by 2,678
- 2018Large Scale GAN Training for High Fidelity Natural Image Synthesiscited by 2,609
- 2017FiLM: Visual Reasoning with a General Conditioning Layercited by 2,286
- 2017Improved Training of Wasserstein GANscited by 2,223
- 2015Variational Inference with Normalizing Flowscited by 2,161
- 2017Arbitrary Style Transfer in Real-time with Adaptive Instance Normalizationcited by 1,998
- 2014Unsupervised Domain Adaptation by Backpropagationcited by 1,906
- 2019Invariant Risk Minimizationcited by 1,832
- 2021Barlow Twins: Self-Supervised Learning via Redundancy Reductioncited by 1,818
- 2018Glow: Generative Flow with Invertible 1x1 Convolutionscited by 1,539
- 2019MixMatch: A Holistic Approach to Semi-Supervised Learningcited by 1,390
- 2020Big Self-Supervised Models are Strong Semi-Supervised Learnerscited by 1,375
- 2019Normalizing Flows for Probabilistic Modeling and Inferencecited by 1,315
- 2019Semantic Image Synthesis with Spatially-Adaptive Normalizationcited by 1,295
- 2016Group Equivariant Convolutional Networkscited by 1,154
- 2021Geometric Deep Learning: Grids, Groups, Graphs, Geodesics, and Gaugescited by 1,131
- 2017CyCADA: Cycle-Consistent Adversarial Domain Adaptationcited by 1,079
- 2014NICE: Non-linear Independent Components Estimationcited by 1,052
- 2016Least Squares Generative Adversarial Networkscited by 1,000
- 2018Challenging Common Assumptions in the Unsupervised Learning of Disentangled Representationscited by 929
- 2020Object-Centric Learning with Slot Attentioncited by 865
- 2016InfoGAN: Interpretable Representation Learning by Information Maximizing Generative Adversarial Netscited by 858
- 2018Multimodal Unsupervised Image-to-Image Translationcited by 795
- 2017Learning to Generalize: Meta-Learning for Domain Generalizationcited by 762
- 2021Generalizing to Unseen Domains: A Survey on Domain Generalizationcited by 762
- 2020Out-of-Distribution Generalization via Risk Extrapolation (REx)cited by 737
- 2018MINE: Mutual Information Neural Estimationcited by 680
- 2013Speech Recognition with Deep Recurrent Neural Networkscited by 666
- 2020Contrastive Learning for Unpaired Image-to-Image Translationcited by 637
- 2020The Future of Digital Health with Federated Learningcited by 625
- 2018Disentangling by Factorisingcited by 614
- 2019Neural Spline Flowscited by 590
- 2019Variational Autoencoders and Nonlinear ICA: A Unifying Frameworkcited by 494
- 2019PointFlow: 3D Point Cloud Generation with Continuous Normalizing Flowscited by 487
- 2020Closed-Form Factorization of Latent Semantics in GANscited by 407
- 2018Pyro: Deep Universal Probabilistic Programmingcited by 379
- 2016Adversarial Feature Learningcited by 350
50 most cited of 183 All 183 (JSON)
Built on by
Citing papers per year: 2022: 10; 2023: 9; 2024: 14; 2025: 10; 2026: 3.
46 papers.
Sort:
By area:
- 2023Multi-modal Learning with Missing Modality via Shared-Specific Feature Modellingcited by 159
- 2022Disentangled Representation Learningcited by 111
- 2022Causal Machine Learning for Healthcare and Precision Medicinecited by 68
- 2024Causal Diffusion Autoencoders: Toward Counterfactual Generation via Diffusion Probabilistic Modelscited by 17
- 2022Controlled Generation of Unseen Faults for Partial and Open-Partial Domain Adaptationcited by 10
- 2023SE(3)-Equivariant and Noise-Invariant 3D Rigid Motion Tracking in Brain MRIcited by 10
- 2024Enhancing Feature Diversity Boosts Channel-Adaptive Vision Transformerscited by 10
- 2022Domain Adaptation for Underwater Image Enhancement via Content and Style Separationcited by 9
- 2022Review of Disentanglement Approaches for Medical Applications -- Towards Solving the Gordian Knot of Generative Models in Healthcarecited by 9
- 2024Disentangling representations of retinal images with generative modelscited by 8
- 2022Representation Learning with Diffusion Modelscited by 6
- 2023Sketch-based Medical Image Retrievalcited by 6
34 more
- 2023Learning Disentangled Semantic Spaces of Explanations via Invertible Neural Networkscited by 6
- 2022A Comprehensive Review of Trends, Applications and Challenges In Out-of-Distribution Detectioncited by 5
- 2024A survey of recent methods for addressing AI fairness and bias in biomedicinecited by 5
- 2024Sequential Representation Learning via Static-Dynamic Conditional Disentanglementcited by 4
- 2023A Causal Ordering Prior for Unsupervised Representation Learningcited by 3
- 2024Pooling Image Datasets With Multiple Covariate Shift and Imbalancecited by 3
- 2025Decoupling Clinical and Class-Agnostic Features for Reliable Few-Shot Adaptation under Shiftcited by 3
- 2023Compositionally Equivariant Representation Learningcited by 2
- 2024Deformation-aware GAN for Medical Image Synthesis with Substantially Misaligned Pairscited by 2
- 2025Causal Disentanglement for Robust Long-tail Medical Image Generationcited by 2
- 2025In-hoc Concept Representations to Regularise Deep Learning in Medical Imagingcited by 2
- 2026Mitigating Translationese Bias in Multilingual LLM-as-a-Judge via Disentangled Information Bottleneckcited by 2
- 2022HSIC-InfoGAN: Learning Unsupervised Disentangled Representations by Maximising Approximated Mutual Informationcited by 1
- 2023Reliable Federated Disentangling Network for Non-IID Domain Featurecited by 1
- 2023Towards Domain-Specific Features Disentanglement for Domain Generalizationcited by 1
- 2024Causal Prototype-inspired Contrast Adaptation for Unsupervised Domain Adaptive Semantic Segmentation of High-resolution Remote Sensing Imagerycited by 1
- 2024Boosting Few-Shot Learning with Disentangled Self-Supervised Learning and Meta-Learning for Medical Image Classificationcited by 1
- 2024FedGS: Federated Gradient Scaling for Heterogeneous Medical Image Segmentationcited by 1
- 2024Human-AI Collaborative Multi-modal Multi-rater Learning for Endometriosis Diagnosiscited by 1
- 2025OWT: A Foundational Organ-Wise Tokenization Framework for Medical Imagingcited by 1
- 2025Causal Representation Learning with Observational Grouping for CXR Classificationcited by 1
- 2025DiViD: Disentangled Video Diffusion for Static-Dynamic Factorizationcited by 1
- 2022Towards Disentangling Information Paths with Coded ResNeXtcited by 0
- 2022Learning Generative Factors of EEG Data with Variational auto-encoderscited by 0
- 2023Interpretability-guided Data Augmentation for Robust Segmentation in Multi-centre Colonoscopy Datacited by 0
- 2024DualContrast: Unsupervised Disentangling of Content and Transformations with Implicit Parameterizationcited by 0
- 2024The Interpretability of Codebooks in Model-Based Reinforcement Learning is Limitedcited by 0
- 2024Enhancing Cross-Modal Medical Image Segmentation through Compositionalitycited by 0
- 2025ConceptVAE: Self-Supervised Fine-Grained Concept Disentanglement from 2D Echocardiographiescited by 0
- 2025A Multi-Centric Anthropomorphic 3D CT Phantom-Based Benchmark Dataset for Harmonizationcited by 0
- 2025Beyond Correlation: Learning Supervised, Sample-Distinct, and Eigenimage-Interpretable Representationscited by 0
- 2025Multimodal Medical Endoscopic Image Analysis via Progressive Disentangle-aware Contrastive Learningcited by 0
- 2026Cross-Camera Cow Identification via Disentangled Representation Learningcited by 0
- 2026MeDUET: Disentangled Unified Pretraining for 3D Medical Image Synthesis and Analysiscited by 0
- 2026Mitigating Translationese Bias in Multilingual LLM-as-a-Judge via Disentangled Information Bottleneck11 Mar 2026
- 2026MeDUET: Disentangled Unified Pretraining for 3D Medical Image Synthesis and Analysis19 Feb 2026
- 2026Cross-Camera Cow Identification via Disentangled Representation Learning7 Feb 2026
- 2025Decoupling Clinical and Class-Agnostic Features for Reliable Few-Shot Adaptation under Shift11 Sep 2025
- 2025Multimodal Medical Endoscopic Image Analysis via Progressive Disentangle-aware Contrastive Learning23 Aug 2025
- 2025In-hoc Concept Representations to Regularise Deep Learning in Medical Imaging19 Aug 2025
- 2025Beyond Correlation: Learning Supervised, Sample-Distinct, and Eigenimage-Interpretable Representations22 Jul 2025
- 2025DiViD: Disentangled Video Diffusion for Static-Dynamic Factorization18 Jul 2025
- 2025A Multi-Centric Anthropomorphic 3D CT Phantom-Based Benchmark Dataset for Harmonization2 Jul 2025
- 2025Causal Representation Learning with Observational Grouping for CXR Classification25 Jun 2025
- 2025OWT: A Foundational Organ-Wise Tokenization Framework for Medical Imaging8 May 2025
- 2025Causal Disentanglement for Robust Long-tail Medical Image Generation20 Apr 2025
34 more
- 2025ConceptVAE: Self-Supervised Fine-Grained Concept Disentanglement from 2D Echocardiographies3 Feb 2025
- 2024Human-AI Collaborative Multi-modal Multi-rater Learning for Endometriosis Diagnosis3 Sep 2024
- 2024Enhancing Cross-Modal Medical Image Segmentation through Compositionality21 Aug 2024
- 2024FedGS: Federated Gradient Scaling for Heterogeneous Medical Image Segmentation21 Aug 2024
- 2024Deformation-aware GAN for Medical Image Synthesis with Substantially Misaligned Pairs18 Aug 2024
- 2024Sequential Representation Learning via Static-Dynamic Conditional Disentanglement10 Aug 2024
- 2024The Interpretability of Codebooks in Model-Based Reinforcement Learning is Limited28 Jul 2024
- 2024DualContrast: Unsupervised Disentangling of Content and Transformations with Implicit Parameterization27 May 2024
- 2024Enhancing Feature Diversity Boosts Channel-Adaptive Vision Transformers26 May 2024
- 2024Causal Diffusion Autoencoders: Toward Counterfactual Generation via Diffusion Probabilistic Models27 Apr 2024
- 2024Boosting Few-Shot Learning with Disentangled Self-Supervised Learning and Meta-Learning for Medical Image Classification26 Mar 2024
- 2024Causal Prototype-inspired Contrast Adaptation for Unsupervised Domain Adaptive Semantic Segmentation of High-resolution Remote Sensing Imagery6 Mar 2024
- 2024Pooling Image Datasets With Multiple Covariate Shift and Imbalance5 Mar 2024
- 2024Disentangling representations of retinal images with generative models29 Feb 2024
- 2024A survey of recent methods for addressing AI fairness and bias in biomedicine13 Feb 2024
- 2023SE(3)-Equivariant and Noise-Invariant 3D Rigid Motion Tracking in Brain MRI21 Dec 2023
- 2023Towards Domain-Specific Features Disentanglement for Domain Generalization4 Oct 2023
- 2023Interpretability-guided Data Augmentation for Robust Segmentation in Multi-centre Colonoscopy Data30 Aug 2023
- 2023Multi-modal Learning with Missing Modality via Shared-Specific Feature Modelling26 Jul 2023
- 2023A Causal Ordering Prior for Unsupervised Representation Learning11 Jul 2023
- 2023Compositionally Equivariant Representation Learning13 Jun 2023
- 2023Learning Disentangled Semantic Spaces of Explanations via Invertible Neural Networks2 May 2023
- 2023Sketch-based Medical Image Retrieval7 Mar 2023
- 2023Reliable Federated Disentangling Network for Non-IID Domain Feature30 Jan 2023
- 2022Disentangled Representation Learning21 Nov 2022
- 2022Representation Learning with Diffusion Models20 Oct 2022
- 2022A Comprehensive Review of Trends, Applications and Challenges In Out-of-Distribution Detection26 Sep 2022
- 2022HSIC-InfoGAN: Learning Unsupervised Disentangled Representations by Maximising Approximated Mutual Information6 Aug 2022
- 2022Learning Generative Factors of EEG Data with Variational auto-encoders4 Jun 2022
- 2022Causal Machine Learning for Healthcare and Precision Medicine23 May 2022
- 2022Controlled Generation of Unseen Faults for Partial and Open-Partial Domain Adaptation29 Apr 2022
- 2022Review of Disentanglement Approaches for Medical Applications -- Towards Solving the Gordian Knot of Generative Models in Healthcare21 Mar 2022
- 2022Domain Adaptation for Underwater Image Enhancement via Content and Style Separation17 Feb 2022
- 2022Towards Disentangling Information Paths with Coded ResNeXt10 Feb 2022
- 2024Causal Diffusion Autoencoders: Toward Counterfactual Generation via Diffusion Probabilistic Modelscited by 17
- 2022Representation Learning with Diffusion Modelscited by 6
- 2025Causal Disentanglement for Robust Long-tail Medical Image Generationcited by 2
- 2025DiViD: Disentangled Video Diffusion for Static-Dynamic Factorizationcited by 1
- 2026MeDUET: Disentangled Unified Pretraining for 3D Medical Image Synthesis and Analysiscited by 0
- 2026MeDUET: Disentangled Unified Pretraining for 3D Medical Image Synthesis and Analysis19 Feb 2026
- 2025DiViD: Disentangled Video Diffusion for Static-Dynamic Factorization18 Jul 2025
- 2025Causal Disentanglement for Robust Long-tail Medical Image Generation20 Apr 2025
- 2024Causal Diffusion Autoencoders: Toward Counterfactual Generation via Diffusion Probabilistic Models27 Apr 2024
- 2022Representation Learning with Diffusion Models20 Oct 2022
- 2023Multi-modal Learning with Missing Modality via Shared-Specific Feature Modellingcited by 159
- 2022Disentangled Representation Learningcited by 111
- 2022Causal Machine Learning for Healthcare and Precision Medicinecited by 68
- 2022Controlled Generation of Unseen Faults for Partial and Open-Partial Domain Adaptationcited by 10
- 2023SE(3)-Equivariant and Noise-Invariant 3D Rigid Motion Tracking in Brain MRIcited by 10
- 2024Enhancing Feature Diversity Boosts Channel-Adaptive Vision Transformerscited by 10
- 2022Domain Adaptation for Underwater Image Enhancement via Content and Style Separationcited by 9
- 2022Review of Disentanglement Approaches for Medical Applications -- Towards Solving the Gordian Knot of Generative Models in Healthcarecited by 9
- 2024Disentangling representations of retinal images with generative modelscited by 8
- 2023Sketch-based Medical Image Retrievalcited by 6
- 2023Learning Disentangled Semantic Spaces of Explanations via Invertible Neural Networkscited by 6
- 2022A Comprehensive Review of Trends, Applications and Challenges In Out-of-Distribution Detectioncited by 5
12 most cited of 40 All 40 (JSON)
- 2026Mitigating Translationese Bias in Multilingual LLM-as-a-Judge via Disentangled Information Bottleneck11 Mar 2026
- 2026Cross-Camera Cow Identification via Disentangled Representation Learning7 Feb 2026
- 2025Multimodal Medical Endoscopic Image Analysis via Progressive Disentangle-aware Contrastive Learning23 Aug 2025
- 2025In-hoc Concept Representations to Regularise Deep Learning in Medical Imaging19 Aug 2025
- 2025Beyond Correlation: Learning Supervised, Sample-Distinct, and Eigenimage-Interpretable Representations22 Jul 2025
- 2025A Multi-Centric Anthropomorphic 3D CT Phantom-Based Benchmark Dataset for Harmonization2 Jul 2025
- 2025Causal Representation Learning with Observational Grouping for CXR Classification25 Jun 2025
- 2025OWT: A Foundational Organ-Wise Tokenization Framework for Medical Imaging8 May 2025
- 2025ConceptVAE: Self-Supervised Fine-Grained Concept Disentanglement from 2D Echocardiographies3 Feb 2025
- 2024Human-AI Collaborative Multi-modal Multi-rater Learning for Endometriosis Diagnosis3 Sep 2024
- 2024Enhancing Cross-Modal Medical Image Segmentation through Compositionality21 Aug 2024
- 2024FedGS: Federated Gradient Scaling for Heterogeneous Medical Image Segmentation21 Aug 2024
12 newest of 40 All 40 (JSON)