mlsanityData to 7 Oct 2026

CPCANet: Deep Unfolding Common Principal Component Analysis for Domain Generalization

arXiv 2605.05136 ↗First posted 6 May 2026cs.CVcited by 1

Not on the map. Why?

Abstract (arXiv)

Domain Generalization (DG) aims to learn representations that remain robust under out-of-distribution (OOD) shifts and generalize effectively to unseen target domains. While recent invariant learning strategies and architectural advances have achieved strong performance, explicitly discovering a structured domain-invariant subspace through second-order statistics remains underexplored. In this work, we propose CPCANet, a novel framework grounded in Common Principal Component Analysis (CPCA), which unrolls the iterative Flury-Gautschi (FG) algorithm into fully differentiable neural layers. This approach integrates the statistical properties of CPCA into an end-to-end trainable framework, enforcing the discovery of a shared subspace across diverse domains while preserving interpretability. Experiments on four standard DG benchmarks demonstrate that CPCANet achieves state-of-the-art (SOTA) performance in zero-shot transfer. Moreover, CPCANet is architecture-agnostic and requires no dataset-specific tuning, providing a simple and efficient approach to learning robust representations under distribution shift. Code is available at https://github.com/wish44165/CPCANet.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 70 of its 118 references that are in the map. First posted on arXiv 6 May 2026.

Builds on

70 of 118 references.

References · 70

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2020Training data-efficient image transformers & distillation through attentioncited by 4,560
  3. 2015Domain-Adversarial Training of Neural Networkscited by 3,023
  4. 2017FiLM: Visual Reasoning with a General Conditioning Layercited by 2,286
  5. 2021MLP-Mixer: An all-MLP Architecture for Visioncited by 1,441
  6. 2016Deep CORAL: Correlation Alignment for Deep Domain Adaptationcited by 1,194
  7. 2018Averaging Weights Leads to Wider Optima and Better Generalizationcited by 1,194
  8. 2017Deep Hashing Network for Unsupervised Domain Adaptationcited by 1,181
  9. 2020In Search of Lost Domain Generalizationcited by 1,042
  10. 2017Deeper, Broader and Artier Domain Generalizationcited by 983
  11. 2024VMamba: Visual State Space Modelcited by 955
  12. 2017Learning to Generalize: Meta-Learning for Domain Generalizationcited by 762
38 more
  1. 2021Generalizing to Unseen Domains: A Survey on Domain Generalizationcited by 762
  2. 2021Domain Generalization: A Surveycited by 760
  3. 2018Recognition in Terra Incognitacited by 655
  4. 2013Domain Generalization via Invariant Feature Representationcited by 622
  5. 2021SWAD: Domain Generalization by Seeking Flat Minimacited by 431
  6. 2021ResMLP: Feedforward networks for image classification with data-efficient trainingcited by 338
  7. 2021Gradient Matching for Domain Generalizationcited by 258
  8. 2020Deep Unfolding Network for Image Super-Resolutioncited by 253
  9. 2021Deep learning: a statistical viewpointcited by 239
  10. 2020Domain Generalization using Causal Matchingcited by 224
  11. 2021Invariance Principle Meets Information Bottleneck for Out-of-Distribution Generalizationcited by 220
  12. 2021SelfReg: Self-supervised Contrastive Regularization for Domain Generalizationcited by 189
  13. 2020Adaptive Risk Minimization: Learning to Adapt to Domain Shiftcited by 183
  14. 2021Ensemble of Averages: Improving Model Selection and Boosting Performance in Domain Generalizationcited by 144
  15. 2022Causality Inspired Representation Learning for Domain Generalizationcited by 136
  16. 2019Cheap Orthogonal Constraints in Neural Networks: A Simple Parametrization of the Orthogonal and Unitary Groupcited by 133
  17. 2022Domain Generalization by Mutual-Information Regularization with Pre-trained Modelscited by 133
  18. 2022Deep Generalized Unfolding Networks for Image Restorationcited by 119
  19. 2022Uncovering the Disentanglement Capability in Text-to-Image Diffusion Modelscited by 116
  20. 2021Open Domain Generalization with Domain-Augmented Meta-Learningcited by 115
  21. 2021Vision Permutator: A Permutable MLP-Like Architecture for Visual Recognitioncited by 103
  22. 2020Learning to Learn with Variational Information Bottleneck for Domain Generalizationcited by 102
  23. 2023Sharpness-Aware Gradient Matching for Domain Generalizationcited by 102
  24. 2021Towards Principled Disentanglement for Domain Generalizationcited by 91
  25. 2022Sparse Mixture-of-Experts are Domain Generalizable Learnerscited by 85
  26. 2020Efficient Riemannian Optimization on the Stiefel Manifold via the Cayley Transformcited by 79
  27. 2014Deep Unfolding: Model-Based Inspiration of Novel Deep Architecturescited by 76
  28. 2020Towards Domain-Agnostic Contrastive Learningcited by 75
  29. 2022Probable Domain Generalization via Quantile Risk Minimizationcited by 66
  30. 2019Deep Unfolding for Communications Systems: A Survey and Some New Directionscited by 48
  31. 2020Iterative Algorithm Induced Deep-Unfolding Neural Networks: Precoding Design for Multiuser MIMO Systemscited by 43
  32. 2023RPCANet: Deep Unfolding RPCA Based Infrared Small Target Detectioncited by 43
  33. 2021Feature Stylization and Domain-aware Contrastive Learning for Domain Generalizationcited by 40
  34. 2021ISTA-Net++: Flexible Deep Unfolding Network for Compressive Sensingcited by 39
  35. 2021Memory-Augmented Deep Unfolding Network for Compressive Sensingcited by 38
  36. 2022Invariant and Transportable Representations for Anti-Causal Domain Shiftscited by 37
  37. 2021Quantifying and Improving Transferability in Domain Generalizationcited by 35
  38. 2022Self-Distilled Vision Transformer for Domain Generalizationcited by 35

50 most cited of 70 All 70 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.