Out of Distribution Generalization via Interventional Style Transfer in Single-Cell Microscopy
Not on the map. Why?
Abstract (arXiv)
Real-world deployment of computer vision systems, including in the discovery processes of biomedical research, requires causal representations that are invariant to contextual nuisances and generalize to new data. Leveraging the internal replicate structure of two novel single-cell fluorescent microscopy datasets, we propose generally applicable tests to assess the extent to which models learn causal representations across increasingly challenging levels of OOD-generalization. We show that despite seemingly strong performance, as assessed by other established metrics, both naive and contemporary baselines designed to ward against confounding, collapse on these tests. We introduce a new method, Interventional Style Transfer (IST), that substantially improves OOD generalization by generating interventional training distributions in which spurious correlations between biological causes and nuisances are mitigated. We publish our code and datasets.
Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Builds on 30 of its 49 references that are in the map. First posted on arXiv 15 Jun 2023.
Builds on
30 of 49 references.
References · 30
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,049
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
- 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,527
- 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,588
- 2015Domain-Adversarial Training of Neural Networkscited by 3,044
- 2018UMAP: Uniform Manifold Approximation and Projection for Dimension Reductioncited by 2,898
- 2020Unsupervised Learning of Visual Features by Contrasting Cluster Assignmentscited by 2,857
- 2017Arbitrary Style Transfer in Real-time with Adaptive Instance Normalizationcited by 2,010
- 2019Invariant Risk Minimizationcited by 1,854
18 more
- 2019Do ImageNet Classifiers Generalize to ImageNet?cited by 1,515
- 2018ImageNet-trained CNNs are biased towards texture; increasing shape bias improves accuracy and robustnesscited by 1,432
- 2019StarGAN v2: Diverse Image Synthesis for Multiple Domainscited by 1,098
- 2017StarGAN: Unified Generative Adversarial Networks for Multi-Domain Image-to-Image Translationcited by 1,039
- 2017Unpaired Image-to-Image Translation using Cycle-Consistent Adversarial Networkscited by 707
- 2021Domain Generalization with MixStylecited by 566
- 2020Rethinking Few-Shot Image Classification: a Good Embedding Is All You Need?cited by 437
- 2017The Effectiveness of Data Augmentation in Image Classification using Deep Learningcited by 370
- 2017Universal Style Transfer via Feature Transformscited by 354
- 2019Adversarial Examples Improve Image Recognitioncited by 286
- 2019Causality for Machine Learningcited by 243
- 2021Towards Causal Representation Learningcited by 209
- 2017Demystifying Neural Style Transfercited by 152
- 2021Explaining in Style: Training a GAN to explain a classifier in StyleSpacecited by 122
- 2022Vision Models Are More Robust And Fair When Pretrained On Uncurated Images Without Supervisioncited by 80
- 2020Exploring Racial Bias within Face Recognition via per-subject Adversarially-Enabled Data Augmentationcited by 45
- 2020Generative Interventions for Causal Learningcited by 45
- 2020Improved Conditional Flow Models for Molecule to Image Synthesiscited by 1
Built on by
Citing papers per year: 2023: 1; 2024: 1; 2025: 1; 2026: 2.
5 papers.
- 2023CHAMMI: A benchmark for channel-adaptive models in microscopy imagingcited by 18
- 2024Gene-Level Representation Learning via Interventional Style Transfer in Optical Pooled Screeningcited by 0
- 2025Uncertainty-Guided Selective Adaptation Enables Cross-Platform Predictive Fluorescence Microscopycited by 0
- 2026Learning domain-invariant features through channel-level sparsification for Out-Of Distribution Generalizationcited by 0
- 2026Who Needs Labels? Adapting Vision Foundation Models With the Metadata You Already Havecited by 0
- 2026Who Needs Labels? Adapting Vision Foundation Models With the Metadata You Already Have3 Jun 2026
- 2026Learning domain-invariant features through channel-level sparsification for Out-Of Distribution Generalization26 Mar 2026
- 2025Uncertainty-Guided Selective Adaptation Enables Cross-Platform Predictive Fluorescence Microscopy15 Nov 2025
- 2024Gene-Level Representation Learning via Interventional Style Transfer in Optical Pooled Screening11 Jun 2024
- 2023CHAMMI: A benchmark for channel-adaptive models in microscopy imaging30 Oct 2023