Causal Inference via Style Transfer for Out-of-distribution Generalisation
Not on the map. Why?
Abstract (arXiv)
Out-of-distribution (OOD) generalisation aims to build a model that can generalise well on an unseen target domain using knowledge from multiple source domains. To this end, the model should seek the causal dependence between inputs and labels, which may be determined by the semantics of inputs and remain invariant across domains. However, statistical or non-causal methods often cannot capture this dependence and perform poorly due to not considering spurious correlations learnt from model training via unobserved confounders. A well-known existing causal inference method like back-door adjustment cannot be applied to remove spurious correlations as it requires the observation of confounders. In this paper, we propose a novel method that effectively deals with hidden confounders by successfully implementing front-door adjustment (FA). FA requires the choice of a mediator, which we regard as the semantic information of images that helps access the causal mechanism without the need for observing confounders. Further, we propose to estimate the combination of the mediator with other observed images in the front-door formula via style transfer algorithms. Our use of style transfer to estimate FA is novel and sensible for OOD generalisation, which we justify by extensive experimental results on widely used benchmark datasets.
Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Builds on 52 of its 72 references that are in the map. First posted on arXiv 6 Dec 2022.
Builds on
52 of 72 references.
References · 52
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
- 2017Arbitrary Style Transfer in Real-time with Adaptive Instance Normalizationcited by 1,998
- 2014Unsupervised Domain Adaptation by Backpropagationcited by 1,906
- 2020The Many Faces of Robustness: A Critical Analysis of Out-of-Distribution Generalizationcited by 1,842
- 2019Invariant Risk Minimizationcited by 1,832
- 2017Deep Hashing Network for Unsupervised Domain Adaptationcited by 1,181
- 2017Deeper, Broader and Artier Domain Generalizationcited by 983
- 2017Learning to Generalize: Meta-Learning for Domain Generalizationcited by 762
- 2021Domain Generalization: A Surveycited by 760
- 2013Domain Generalization via Invariant Feature Representationcited by 622
- 2021Domain Generalization with MixStylecited by 563
38 more
- 2019Domain Generalization by Solving Jigsaw Puzzlescited by 449
- 2021Towards Out-Of-Distribution Generalization: A Surveycited by 431
- 2020Self-Challenging Improves Cross-Domain Generalizationcited by 426
- 2019Domain Generalization via Model-Agnostic Learning of Semantic Featurescited by 405
- 2017Unified Deep Supervised Domain Adaptation and Generalizationcited by 322
- 2021Self-Supervised Learning with Data Augmentations Provably Isolates Content from Stylecited by 308
- 2020Learning to Generate Novel Domains for Domain Generalizationcited by 296
- 2021A Fourier-based Framework for Domain Generalizationcited by 287
- 2018Nonlinear ICA Using Auxiliary Variables and Generalized Contrastive Learningcited by 278
- 2018Generalizing Across Domains via Cross-Gradient Trainingcited by 268
- 2020Deep Domain-Adversarial Image Generation for Domain Generalisationcited by 231
- 2020Causal Intervention for Weakly-Supervised Semantic Segmentationcited by 229
- 2020Domain Generalization using Causal Matchingcited by 224
- 2020A Survey on Causal Inferencecited by 202
- 2017Neural Style Transfer: A Reviewcited by 199
- 2020Representation Learning via Invariant Causal Mechanismscited by 197
- 2020Domain Adaptive Ensemble Learningcited by 156
- 2016Identifying Causal Effects With Proxy Variables of an Unmeasured Confoundercited by 138
- 2022Causality Inspired Representation Learning for Domain Generalizationcited by 136
- 2017Domain Adaptation by Using Causal Inference to Predict Invariant Conditional Distributionscited by 125
- 2022Exact Feature Distribution Matching for Arbitrary Style Transfer and Domain Generalizationcited by 122
- 2021Causal Attention for Vision-Language Taskscited by 111
- 2020Learning to Generalize Unseen Domains via Memory-based Multi-Source Meta-Learning for Person Re-Identificationcited by 110
- 2020Visual Commonsense R-CNNcited by 106
- 2020Deconfounded Image Captioning: A Causal Retrospectcited by 65
- 2020Few-shot Domain Adaptation by Causal Mechanism Transfercited by 47
- 2022Out-of-distribution Generalization with Causal Invariant Transformationscited by 45
- 2022Harnessing Out-Of-Distribution Examples via Augmenting Content and Stylecited by 43
- 2022From Statistical to Causal Learningcited by 40
- 2021Transporting Causal Mechanisms for Unsupervised Domain Adaptationcited by 38
- 2022Pareto Invariant Risk Minimization: Towards Mitigating the Optimization Dilemma in Out-of-Distribution Generalizationcited by 38
- 2022Invariant and Transportable Representations for Anti-Causal Domain Shiftscited by 37
- 2021A Bit More Bayesian: Domain-Invariant Learning with Uncertaintycited by 27
- 2020Sequential Learning for Domain Generalizationcited by 25
- 2022Causal Transportability for Visual Recognitioncited by 23
- 2021Deconfounded Visual Groundingcited by 16
- 2021Adversarial Visual Robustness by Causal Interventioncited by 13
- 2020Random Style Transfer based Domain Generalization Networks Integrating Shape and Spatial Informationcited by 12
50 most cited of 52 All 52 (JSON)
Built on by
Citing papers per year: 2023: 1; 2024: 4; 2025: 3.
8 papers.
- 2023Domain Generalisation via Risk Distribution Matchingcited by 14
- 2024Generalizable Single-Source Cross-modality Medical Image Segmentation via Invariant Causal Mechanismscited by 5
- 2024Causality-inspired Latent Feature Augmentation for Single Domain Generalizationcited by 1
- 2024DICS: Find Domain-Invariant and Class-Specific Features for Out-of-Distribution Generalizationcited by 1
- 2024Causal Fine-Tuning under Latent Confounded Shiftcited by 0
- 2025Casual Inference via Style Bias Deconfounding for Domain Generalizationcited by 0
- 2025CLEAR: Causal Learning Framework For Robust Histopathology Tumor Detection Under Out-Of-Distribution Shiftscited by 0
- 2025CaberNet: Causal Representation Learning for Cross-Domain HVAC Energy Predictioncited by 0
- 2025CaberNet: Causal Representation Learning for Cross-Domain HVAC Energy Prediction10 Nov 2025
- 2025CLEAR: Causal Learning Framework For Robust Histopathology Tumor Detection Under Out-Of-Distribution Shifts16 Oct 2025
- 2025Casual Inference via Style Bias Deconfounding for Domain Generalization21 Mar 2025
- 2024Generalizable Single-Source Cross-modality Medical Image Segmentation via Invariant Causal Mechanisms7 Nov 2024
- 2024Causal Fine-Tuning under Latent Confounded Shift18 Oct 2024
- 2024DICS: Find Domain-Invariant and Class-Specific Features for Out-of-Distribution Generalization13 Sep 2024
- 2024Causality-inspired Latent Feature Augmentation for Single Domain Generalization10 Jun 2024
- 2023Domain Generalisation via Risk Distribution Matching28 Oct 2023