mlsanityData to 14 Oct 2026

AI-based association analysis for medical imaging using latent-space geometric confounder correction

arXiv 2311.12836 ↗First posted 3 Oct 2023cs.CV cs.AI cs.LGcited by 1

Not on the map. Why?

Abstract (arXiv)

This study addresses the challenges of confounding effects and interpretability in artificial-intelligence-based medical image analysis. Whereas existing literature often resolves confounding by removing confounder-related information from latent representations, this strategy risks affecting image reconstruction quality in generative models, thus limiting their applicability in feature visualization. To tackle this, we propose a different strategy that retains confounder-related information in latent representations while finding an alternative confounder-free representation of the image data. Our approach views the latent space of an autoencoder as a vector space, where imaging-related variables, such as the learning target (t) and confounder (c), have a vector capturing their variability. The confounding problem is addressed by searching a confounder-free vector which is orthogonal to the confounder-related vector but maximally collinear to the target-related vector. To achieve this, we introduce a novel correlation-based loss that not only performs vector searching in the latent space, but also encourages the encoder to generate latent representations linearly correlated with the variables. Subsequently, we interpret the confounder-free representation by sampling and reconstructing images along the confounder-free vector. The efficacy and flexibility of our proposed method are demonstrated across three applications, accommodating multiple confounders and utilizing diverse image modalities. Results affirm the method's effectiveness in reducing confounder influences, preventing wrong or misleading associations, and offering a unique visual interpretation for in-depth investigations by clinical and epidemiological researchers. The code is released in the following GitLab repository: https://gitlab.com/radiology/compopbio/ai_based_association_analysis}

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 33 of its 78 references that are in the map. First posted on arXiv 3 Oct 2023.

Builds on

33 of 78 references.

References · 33

  1. 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,733
  2. 2017A Unified Approach to Interpreting Model Predictionscited by 6,555
  3. 2016Deep Variational Information Bottleneckcited by 930
  4. 2016InfoGAN: Interpretable Representation Learning by Information Maximizing Generative Adversarial Netscited by 860
  5. 2018MINE: Mutual Information Neural Estimationcited by 683
  6. 2018Mitigating Unwanted Biases with Adversarial Learningcited by 663
  7. 2020Unsupervised Discovery of Interpretable Directions in the GAN Latent Spacecited by 289
  8. 2015Explaining NonLinear Classification Decisions with Deep Taylor Decompositioncited by 250
  9. 2015The Variational Fair Autoencodercited by 223
  10. 2019Flexibly Fair Representation Learning by Disentanglementcited by 196
  11. 2015Censoring Representations with an Adversarycited by 192
  12. 2019REPAIR: Removing Representation Bias by Dataset Resamplingcited by 157
21 more
  1. 2021Explainable artificial intelligence (XAI) in deep learning-based medical image analysiscited by 147
  2. 2017Controllable Invariance through Adversarial Feature Learningcited by 127
  3. 2021Learning Debiased Representation via Disentangled Feature Augmentationcited by 116
  4. 2019SpiralNet++: A Fast and Highly Efficient Mesh Convolution Operatorcited by 89
  5. 2020On Interpretability of Artificial Neural Networks: A Surveycited by 88
  6. 2020Fairness by Learning Orthogonal Disentangled Representationscited by 76
  7. 2021BiaSwap: Removing dataset bias with bias-tailored swapping augmentationcited by 70
  8. 2020Towards causal benchmarking of bias in face analysis algorithmscited by 64
  9. 2021Universal Representation Learning from Multiple Domains for Few-shot Classificationcited by 56
  10. 2019Multi-Task Attention-Based Semi-Supervised Learning for Medical Image Segmentationcited by 55
  11. 2019Adversarial Invariant Feature Learning with Accuracy Constraint for Domain Generalizationcited by 43
  12. 2022PKD: General Distillation Framework for Object Detectors via Pearson Correlation Coefficientcited by 41
  13. 2019Variational AutoEncoder For Regression: Application to Brain Aging Analysiscited by 30
  14. 2017Teaching Compositionality to CNNscited by 18
  15. 2021Fair Representation: Guaranteeing Approximate Multiple Group Fairness for Unknown Taskscited by 16
  16. 2020Mutual Information Gradient Estimation for Representation Learningcited by 14
  17. 2021Metadata Normalizationcited by 14
  18. 2022Deep Learning Discovery of Demographic Biomarkers in Echocardiographycited by 12
  19. 2022A Penalty Approach for Normalizing Feature Distributions to Build Confounder-Free Modelscited by 8
  20. 2021Projection-wise Disentangling for Fair and Interpretable Representation Learning: Application to 3D Facial Shape Analysiscited by 5
  21. 2022Fine-grained Correlation Loss for Regressioncited by 4

Built on by

Cited by year

Citing papers per year: 2025: 1.

1 paper.