CPCANet: Deep Unfolding Common Principal Component Analysis for Domain Generalization
Not on the map. Why?
Abstract (arXiv)
Domain Generalization (DG) aims to learn representations that remain robust under out-of-distribution (OOD) shifts and generalize effectively to unseen target domains. While recent invariant learning strategies and architectural advances have achieved strong performance, explicitly discovering a structured domain-invariant subspace through second-order statistics remains underexplored. In this work, we propose CPCANet, a novel framework grounded in Common Principal Component Analysis (CPCA), which unrolls the iterative Flury-Gautschi (FG) algorithm into fully differentiable neural layers. This approach integrates the statistical properties of CPCA into an end-to-end trainable framework, enforcing the discovery of a shared subspace across diverse domains while preserving interpretability. Experiments on four standard DG benchmarks demonstrate that CPCANet achieves state-of-the-art (SOTA) performance in zero-shot transfer. Moreover, CPCANet is architecture-agnostic and requires no dataset-specific tuning, providing a simple and efficient approach to learning robust representations under distribution shift. Code is available at https://github.com/wish44165/CPCANet.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 70 of its 118 references that are in the map. First posted on arXiv 6 May 2026.
Builds on
70 of 118 references.
References · 70
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2020Training data-efficient image transformers & distillation through attentioncited by 4,560
- 2015Domain-Adversarial Training of Neural Networkscited by 3,023
- 2017FiLM: Visual Reasoning with a General Conditioning Layercited by 2,286
- 2021MLP-Mixer: An all-MLP Architecture for Visioncited by 1,441
- 2016Deep CORAL: Correlation Alignment for Deep Domain Adaptationcited by 1,194
- 2018Averaging Weights Leads to Wider Optima and Better Generalizationcited by 1,194
- 2017Deep Hashing Network for Unsupervised Domain Adaptationcited by 1,181
- 2020In Search of Lost Domain Generalizationcited by 1,042
- 2017Deeper, Broader and Artier Domain Generalizationcited by 983
- 2024VMamba: Visual State Space Modelcited by 955
- 2017Learning to Generalize: Meta-Learning for Domain Generalizationcited by 762
38 more
- 2021Generalizing to Unseen Domains: A Survey on Domain Generalizationcited by 762
- 2021Domain Generalization: A Surveycited by 760
- 2018Recognition in Terra Incognitacited by 655
- 2013Domain Generalization via Invariant Feature Representationcited by 622
- 2021SWAD: Domain Generalization by Seeking Flat Minimacited by 431
- 2021ResMLP: Feedforward networks for image classification with data-efficient trainingcited by 338
- 2021Gradient Matching for Domain Generalizationcited by 258
- 2020Deep Unfolding Network for Image Super-Resolutioncited by 253
- 2021Deep learning: a statistical viewpointcited by 239
- 2020Domain Generalization using Causal Matchingcited by 224
- 2021Invariance Principle Meets Information Bottleneck for Out-of-Distribution Generalizationcited by 220
- 2021SelfReg: Self-supervised Contrastive Regularization for Domain Generalizationcited by 189
- 2020Adaptive Risk Minimization: Learning to Adapt to Domain Shiftcited by 183
- 2021Ensemble of Averages: Improving Model Selection and Boosting Performance in Domain Generalizationcited by 144
- 2022Causality Inspired Representation Learning for Domain Generalizationcited by 136
- 2019Cheap Orthogonal Constraints in Neural Networks: A Simple Parametrization of the Orthogonal and Unitary Groupcited by 133
- 2022Domain Generalization by Mutual-Information Regularization with Pre-trained Modelscited by 133
- 2022Deep Generalized Unfolding Networks for Image Restorationcited by 119
- 2022Uncovering the Disentanglement Capability in Text-to-Image Diffusion Modelscited by 116
- 2021Open Domain Generalization with Domain-Augmented Meta-Learningcited by 115
- 2021Vision Permutator: A Permutable MLP-Like Architecture for Visual Recognitioncited by 103
- 2020Learning to Learn with Variational Information Bottleneck for Domain Generalizationcited by 102
- 2023Sharpness-Aware Gradient Matching for Domain Generalizationcited by 102
- 2021Towards Principled Disentanglement for Domain Generalizationcited by 91
- 2022Sparse Mixture-of-Experts are Domain Generalizable Learnerscited by 85
- 2020Efficient Riemannian Optimization on the Stiefel Manifold via the Cayley Transformcited by 79
- 2014Deep Unfolding: Model-Based Inspiration of Novel Deep Architecturescited by 76
- 2020Towards Domain-Agnostic Contrastive Learningcited by 75
- 2022Probable Domain Generalization via Quantile Risk Minimizationcited by 66
- 2019Deep Unfolding for Communications Systems: A Survey and Some New Directionscited by 48
- 2020Iterative Algorithm Induced Deep-Unfolding Neural Networks: Precoding Design for Multiuser MIMO Systemscited by 43
- 2023RPCANet: Deep Unfolding RPCA Based Infrared Small Target Detectioncited by 43
- 2021Feature Stylization and Domain-aware Contrastive Learning for Domain Generalizationcited by 40
- 2021ISTA-Net++: Flexible Deep Unfolding Network for Compressive Sensingcited by 39
- 2021Memory-Augmented Deep Unfolding Network for Compressive Sensingcited by 38
- 2022Invariant and Transportable Representations for Anti-Causal Domain Shiftscited by 37
- 2021Quantifying and Improving Transferability in Domain Generalizationcited by 35
- 2022Self-Distilled Vision Transformer for Domain Generalizationcited by 35
50 most cited of 70 All 70 (JSON)
Built on by
Citing papers per year: 2026: 1.
1 paper.
- 2026Projection Pursuit CPCANet for Domain Generalizationcited by 0
- 2026Projection Pursuit CPCANet for Domain Generalization24 Jul 2026