mlsanityData to 14 Oct 2026

CMVAE: Causal Meta VAE for Unsupervised Meta-Learning

arXiv 2302.09731 ↗First posted 20 Feb 2023cs.LG cs.AIcited by 3

Not on the map. Why?

Abstract (arXiv)

Unsupervised meta-learning aims to learn the meta knowledge from unlabeled data and rapidly adapt to novel tasks. However, existing approaches may be misled by the context-bias (e.g. background) from the training data. In this paper, we abstract the unsupervised meta-learning problem into a Structural Causal Model (SCM) and point out that such bias arises due to hidden confounders. To eliminate the confounders, we define the priors are textitconditionally independent, learn the relationships between priors and intervene on them with casual factorization. Furthermore, we propose Causal Meta VAE (CMVAE) that encodes the priors into latent codes in the causal space and learns their relationships simultaneously to achieve the downstream few-shot image classification task. Results on toy datasets and three benchmark datasets demonstrate that our method can remove the context-bias and it outperforms other state-of-the-art unsupervised meta-learning algorithms because of bias-removal. Code is available at urlhttps://github.com/GuodongQi/CMVAE

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 32 of its 45 references that are in the map. First posted on arXiv 20 Feb 2023.

Builds on

32 of 45 references.

References · 32

  1. 2017Attention Is All You Needcited by 60,361
  2. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  3. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,049
  4. 2014ImageNet Large Scale Visual Recognition Challengecited by 8,498
  5. 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,897
  6. 2017Prototypical Networks for Few-shot Learningcited by 3,015
  7. 2018Challenging Common Assumptions in the Unsupervised Learning of Disentangled Representationscited by 941
  8. 2018DAGs with NO TEARS: Continuous Optimization for Structure Learningcited by 752
  9. 2022Compositional Visual Generation with Composable Diffusion Modelscited by 624
  10. 2019Variational Autoencoders and Nonlinear ICA: A Unifying Frameworkcited by 503
  11. 2016Adversarial Feature Learningcited by 350
  12. 2019Learning Sparse Nonparametric DAGscited by 207
20 more
  1. 2019A Meta-Transfer Objective for Learning to Disentangle Causal Mechanismscited by 158
  2. 2021Investigating Bi-Level Optimization for Learning and Vision from a Unified Perspective: A Survey and Beyondcited by 153
  3. 2017Domain Adaptation by Using Causal Inference to Predict Invariant Conditional Distributionscited by 126
  4. 2020Interventional Few-Shot Learningcited by 112
  5. 2021Causal Attention for Vision-Language Taskscited by 111
  6. 2020Visual Commonsense R-CNNcited by 106
  7. 2018The Blessings of Multiple Causescited by 104
  8. 2020On Disentangled Representations Learned From Correlated Datacited by 94
  9. 2018Understanding and Improving Interpolation in Autoencoders via an Adversarial Regularizercited by 88
  10. 2018Unsupervised Learning via Meta-Learningcited by 82
  11. 2016Discovering Causal Signals in Imagescited by 79
  12. 2018Unsupervised Meta-Learning For Few-Shot Image Classificationcited by 75
  13. 2022Differentiable DAG Samplingcited by 47
  14. 2020Counterfactual Fairness with Disentangled Causal Effect Variational Autoencodercited by 45
  15. 2020CASTLE: Regularization via Auxiliary Causal Graph Discoverycited by 41
  16. 2020Towards Scalable Bayesian Learning of Causal DAGscited by 33
  17. 2022On Implicit Bias in Overparameterized Bilevel Optimizationcited by 30
  18. 2019Ordering-Based Causal Structure Learning in the Presence of Latent Variablescited by 26
  19. 2020Unsupervised Meta-Learning through Latent-Space Interpolation in Generative Modelscited by 26
  20. 2021Unsupervised Foreground Extraction via Deep Region Competitioncited by 26

Built on by

Cited by year

Citing papers per year: 2024: 1; 2025: 2.

3 papers.