Interventional Few-Shot Learning
Not on the map. Why?
Abstract (arXiv)
We uncover an ever-overlooked deficiency in the prevailing Few-Shot Learning (FSL) methods: the pre-trained knowledge is indeed a confounder that limits the performance. This finding is rooted from our causal assumption: a Structural Causal Model (SCM) for the causalities among the pre-trained knowledge, sample features, and labels. Thanks to it, we propose a novel FSL paradigm: Interventional Few-Shot Learning (IFSL). Specifically, we develop three effective IFSL algorithmic implementations based on the backdoor adjustment, which is essentially a causal intervention towards the SCM of many-shot learning: the upper-bound of FSL in a causal view. It is worth noting that the contribution of IFSL is orthogonal to existing fine-tuning and meta-learning based FSL methods, hence IFSL can improve all of them, achieving a new 1-/5-shot state-of-the-art on textitminiImageNet, textittieredImageNet, and cross-domain CUB. Code is released at https://github.com/yue-zhongqi/ifsl.
Key facts. Cited by 112 papers in the map (data through 7 Oct 2026). First posted on arXiv 28 Sep 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 35; 2022: 19; 2023: 33; 2024: 15; 2025: 7; 2026: 3.
112 papers.
Sort:
By area:
- 2021GPT Understands, Toocited by 715
- 2021Few-Shot Incremental Learning with Continually Evolved Classifierscited by 184
- 2021Overcoming Catastrophic Forgetting in Incremental Few-Shot Learning by Finding Flat Minimacited by 118
- 2021Distilling Causal Effect of Data in Class-Incremental Learningcited by 117
- 2021Causal Attention for Vision-Language Taskscited by 111
- 2021Counterfactual Zero-Shot and Open-Set Visual Recognitioncited by 95
- 2021Interventional Video Grounding with Dual Contrastive Learningcited by 94
- 2023Interventional Bag Multi-Instance Learning On Whole-Slide Pathological Imagescited by 91
- 2021Deconfounded Video Moment Retrieval with Causal Interventioncited by 84
- 2021Causal Attention for Unbiased Visual Recognitioncited by 80
- 2023Unbiased Multiple Instance Learning for Weakly Supervised Video Anomaly Detectioncited by 64
- 2022Cross-Modal Causal Relational Reasoning for Event-Level Visual Question Answeringcited by 57
38 more
- 2022Assaying Out-Of-Distribution Generalization in Transfer Learningcited by 53
- 2021Rectifying the Shortcut Learning of Background for Few-Shot Learningcited by 51
- 2024Vision-and-Language Navigation via Causal Learningcited by 51
- 2021Meta-Learning with Task-Adaptive Loss Function for Few-Shot Learningcited by 49
- 2021Self-Supervised Learning Disentangled Group Representation as Featurecited by 47
- 2023Backdoor Defense via Deconfounded Representation Learningcited by 38
- 2023GaitGCI: Generative Counterfactual Intervention for Gait Recognitioncited by 30
- 2023Towards Trustworthy and Aligned Machine Learning: A Data-centric Survey with Causality Perspectivescited by 30
- 2022Neuro-Symbolic Procedural Planning with Commonsense Promptingcited by 28
- 2022Causal Reasoning Meets Visual Representation Learning: A Prospective Studycited by 24
- 2021Transductive Few-Shot Classification on the Oblique Manifoldcited by 23
- 2022Causal Transportability for Visual Recognitioncited by 23
- 2022Certified Robustness Against Natural Language Attacks by Causal Interventioncited by 23
- 2021Learning Domain Invariant Representations for Generalizable Person Re-Identificationcited by 22
- 2021Uncovering Main Causalities for Long-tailed Information Extractioncited by 21
- 2023Neurosymbolic AI for Reasoning over Knowledge Graphs: A Surveycited by 21
- 2023Debiased Fine-Tuning for Vision-language Models by Prompt Regularizationcited by 20
- 2023Causal Unsupervised Semantic Segmentationcited by 18
- 2023Learning Distortion Invariant Representation for Image Restoration from A Causality Perspectivecited by 17
- 2021The Blessings of Unlabeled Background in Untrimmed Videoscited by 16
- 2021Deconfounded Visual Groundingcited by 16
- 2023Shift-Robust Molecular Relational Learning with Causal Substructurecited by 15
- 2021Improving Weakly-supervised Object Localization via Causal Interventioncited by 14
- 2023Deep Learning for Cross-Domain Few-Shot Visual Recognition: A Surveycited by 14
- 2023Cross-Modal Causal Intervention for Medical Report Generationcited by 14
- 2021Adversarial Visual Robustness by Causal Interventioncited by 13
- 2021Weakly-Supervised Video Object Grounding via Causal Interventioncited by 13
- 2022Interventional Multi-Instance Learning with Deconfounded Instance-Level Predictioncited by 13
- 2023T2TD: Text-3D Generation Model based on Prior Knowledge Guidancecited by 13
- 2021CAM-loss: Towards Learning Spatially Discriminative Feature Representationscited by 12
- 2023Causal reasoning in typical computer vision taskscited by 12
- 2021Towards Unbiased Visual Emotion Recognition via Causal Interventioncited by 11
- 2022Causal Intervention for Subject-Deconfounded Facial Action Unit Recognitioncited by 11
- 2024Few-shot Learner Parameterization by Diffusion Time-stepscited by 11
- 2021Conterfactual Generative Zero-Shot Semantic Segmentationcited by 10
- 2021Confounder Identification-free Causal Visual Feature Learningcited by 10
- 2024Boosting Few-Shot Learning via Attentive Feature Regularizationcited by 10
- 2021Honey or Poison? Solving the Trigger Curse in Few-shot Event Detection via Causal Interventioncited by 9
50 most cited of 112 All 112 (JSON)
- 2026Mutually Causal Semantic Distillation Network for Zero-Shot Learning18 Mar 2026
- 2026CVGL: Causal Learning and Geometric Topology13 Mar 2026
- 2026Extending Sequence Length is Not All You Need: Effective Integration of Multimodal Signals for Gene Expression Prediction25 Feb 2026
- 2025Robust Egocentric Referring Video Object Segmentation via Dual-Modal Causal Intervention30 Dec 2025
- 2025CausalFSFG: Rethinking Few-Shot Fine-Grained Visual Categorization from Causal Perspective25 Dec 2025
- 2025Beyond Objects: Contextual Synthetic Data Generation for Fine-Grained Classification28 Oct 2025
- 2025Exploring Cross-Modal Flows for Few-Shot Learning16 Oct 2025
- 2025Efficient and Generalizable Environmental Understanding for Visual Navigation18 Jun 2025
- 2025Causal-LLaVA: Causal Disentanglement for Mitigating Hallucination in Multimodal Large Language Models26 May 2025
- 2025Structure Causal Models and LLMs Integration in Medical Visual Question Answering5 May 2025
- 2024Image Quality Assessment: Investigating Causal Perceptual Effects with Abductive Counterfactual Inference22 Dec 2024
- 2024Invariant Shape Representation Learning For Image Classification19 Nov 2024
38 more
- 2024Causal Fine-Tuning under Latent Confounded Shift18 Oct 2024
- 2024Facial Action Unit Detection by Adaptively Constraining Self-Attention and Causally Deconfounding Sample2 Oct 2024
- 2024Rethinking Misalignment in Vision-Language Model Adaptation from a Causal Perspective1 Oct 2024
- 2024Benchmarking Spurious Bias in Few-Shot Image Classifiers4 Sep 2024
- 2024Deconfounded Causality-aware Parameter-Efficient Fine-Tuning for Problem-Solving Improvement of LLMs4 Sep 2024
- 2024Interpreting Low-level Vision Models with Causal Effect Maps29 Jul 2024
- 2024Self-Supervised Video Representation Learning in a Heuristic Decoupled Perspective19 Jul 2024
- 2024Harnessing the Power of Local Representations for Few-Shot Classification2 Jul 2024
- 2024MetaCoCo: A New Few-Shot Classification Benchmark with Spurious Correlation30 Apr 2024
- 2024Vision-and-Language Navigation via Causal Learning16 Apr 2024
- 2024Boosting Few-Shot Learning via Attentive Feature Regularization23 Mar 2024
- 2024Few-shot Learner Parameterization by Diffusion Time-steps5 Mar 2024
- 2024Learning Causal Features for Incremental Object Detection1 Mar 2024
- 2023Hacking Task Confounder in Meta-Learning10 Dec 2023
- 2023Disentangled Representation Learning with Transmitted Information Bottleneck3 Nov 2023
- 2023Understanding the Effects of Projectors in Knowledge Distillation26 Oct 2023
- 2023BanglaNLP at BLP-2023 Task 2: Benchmarking different Transformer Models for Sentiment Analysis of Bangla Social Media Posts13 Oct 2023
- 2023Causal Unsupervised Semantic Segmentation11 Oct 2023
- 2023Causal-DFQ: Causality Guided Data-free Network Quantization24 Sep 2023
- 2023Causality-Driven One-Shot Learning for Prostate Cancer Grading from MRI19 Sep 2023
- 2023Benign Shortcut for Debiasing: Fair Visual Recognition via Intervention with Shortcut Features13 Aug 2023
- 2023Towards Trustworthy and Aligned Machine Learning: A Data-centric Survey with Causality Perspectives31 Jul 2023
- 2023Causal reasoning in typical computer vision tasks26 Jul 2023
- 2023Neurosymbolic AI for Reasoning on Biomedical Knowledge Graphs17 Jul 2023
- 2023GaitGCI: Generative Counterfactual Intervention for Gait Recognition6 Jun 2023
- 2023Unveiling Cross Modality Bias in Visual Question Answering: A Causal View with Possible Worlds VQA31 May 2023
- 2023Shift-Robust Molecular Relational Learning with Causal Substructure29 May 2023
- 2023Point Cloud Completion Guided by Prior Knowledge via Causal Inference28 May 2023
- 2023T2TD: Text-3D Generation Model based on Prior Knowledge Guidance25 May 2023
- 2023Counterfactual Co-occurring Learning for Bias Mitigation in Weakly-supervised Object Localization24 May 2023
- 2023Instrumental Variable Learning for Chest X-ray Classification20 May 2023
- 2023Few Shot Learning for Medical Imaging: A Comparative Analysis of Methodologies and Formal Mathematical Framework8 May 2023
- 2023Causal Interventions-based Few-Shot Named Entity Recognition3 May 2023
- 2023Task Adaptive Feature Transformation for One-Shot Learning13 Apr 2023
- 2023Unbiased Multiple Instance Learning for Weakly Supervised Video Anomaly Detection22 Mar 2023
- 2023Cross-Modal Causal Intervention for Medical Report Generation16 Mar 2023
- 2023Deep Learning for Cross-Domain Few-Shot Visual Recognition: A Survey15 Mar 2023
- 2023Interventional Bag Multi-Instance Learning On Whole-Slide Pathological Images13 Mar 2023
50 newest of 112 All 112 (JSON)
- 2022Cross-Modal Causal Relational Reasoning for Event-Level Visual Question Answeringcited by 57
- 2022Causal Reasoning Meets Visual Representation Learning: A Prospective Studycited by 24
- 2023Neurosymbolic AI for Reasoning over Knowledge Graphs: A Surveycited by 21
- 2023Causal reasoning in typical computer vision taskscited by 12
- 2024Rethinking Misalignment in Vision-Language Model Adaptation from a Causal Perspectivecited by 9
- 2024Deconfounded Causality-aware Parameter-Efficient Fine-Tuning for Problem-Solving Improvement of LLMscited by 0
- 2024Rethinking Misalignment in Vision-Language Model Adaptation from a Causal Perspective1 Oct 2024
- 2024Deconfounded Causality-aware Parameter-Efficient Fine-Tuning for Problem-Solving Improvement of LLMs4 Sep 2024
- 2023Causal reasoning in typical computer vision tasks26 Jul 2023
- 2023Neurosymbolic AI for Reasoning over Knowledge Graphs: A Survey14 Feb 2023
- 2022Cross-Modal Causal Relational Reasoning for Event-Level Visual Question Answering26 Jul 2022
- 2022Causal Reasoning Meets Visual Representation Learning: A Prospective Study26 Apr 2022
- 2021GPT Understands, Toocited by 715
- 2021Few-Shot Incremental Learning with Continually Evolved Classifierscited by 184
- 2021Overcoming Catastrophic Forgetting in Incremental Few-Shot Learning by Finding Flat Minimacited by 118
- 2021Distilling Causal Effect of Data in Class-Incremental Learningcited by 117
- 2021Counterfactual Zero-Shot and Open-Set Visual Recognitioncited by 95
- 2021Interventional Video Grounding with Dual Contrastive Learningcited by 94
- 2023Interventional Bag Multi-Instance Learning On Whole-Slide Pathological Imagescited by 91
- 2021Deconfounded Video Moment Retrieval with Causal Interventioncited by 84
- 2021Causal Attention for Unbiased Visual Recognitioncited by 80
- 2023Unbiased Multiple Instance Learning for Weakly Supervised Video Anomaly Detectioncited by 64
- 2022Assaying Out-Of-Distribution Generalization in Transfer Learningcited by 53
- 2021Rectifying the Shortcut Learning of Background for Few-Shot Learningcited by 51
12 most cited of 102 All 102 (JSON)
- 2026Mutually Causal Semantic Distillation Network for Zero-Shot Learning18 Mar 2026
- 2026CVGL: Causal Learning and Geometric Topology13 Mar 2026
- 2026Extending Sequence Length is Not All You Need: Effective Integration of Multimodal Signals for Gene Expression Prediction25 Feb 2026
- 2025Robust Egocentric Referring Video Object Segmentation via Dual-Modal Causal Intervention30 Dec 2025
- 2025CausalFSFG: Rethinking Few-Shot Fine-Grained Visual Categorization from Causal Perspective25 Dec 2025
- 2025Beyond Objects: Contextual Synthetic Data Generation for Fine-Grained Classification28 Oct 2025
- 2025Exploring Cross-Modal Flows for Few-Shot Learning16 Oct 2025
- 2025Efficient and Generalizable Environmental Understanding for Visual Navigation18 Jun 2025
- 2025Structure Causal Models and LLMs Integration in Medical Visual Question Answering5 May 2025
- 2024Image Quality Assessment: Investigating Causal Perceptual Effects with Abductive Counterfactual Inference22 Dec 2024
- 2024Invariant Shape Representation Learning For Image Classification19 Nov 2024
- 2024Causal Fine-Tuning under Latent Confounded Shift18 Oct 2024
12 newest of 102 All 102 (JSON)