People infer recursive visual concepts from just a few examples
Not on the map. Why?
Abstract (arXiv)
Machine learning has made major advances in categorizing objects in images, yet the best algorithms miss important aspects of how people learn and think about categories. People can learn richer concepts from fewer examples, including causal models that explain how members of a category are formed. Here, we explore the limits of this human ability to infer causal "programs" -- latent generating processes with nontrivial algorithmic properties -- from one, two, or three visual examples. People were asked to extrapolate the programs in several ways, for both classifying and generating new examples. As a theory of these inductive abilities, we present a Bayesian program learning model that searches the space of programs for the best explanation of the observations. Although variable, people's judgments are broadly consistent with the model and inconsistent with several alternatives, including a pre-trained deep neural network for object recognition, indicating that people can learn and reason with rich algorithmic abstractions from sparse input data.
Key facts. Cited by 23 papers in the map (data through 7 Oct 2026). First posted on arXiv 17 Apr 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 6; 2022: 4; 2023: 6; 2024: 4; 2025: 3.
23 papers.
Sort:
By area:
- 2022"This is my unicorn, Fluffy": Personalizing frozen vision-language representationscited by 95
- 2021Communicating Natural Programs to Humans and Machinescited by 35
- 2025PoE-World: Compositional World Modeling with Products of Programmatic Expertscited by 25
- 2023SEVA: Leveraging sketches to evaluate alignment between human and machine visual abstractioncited by 14
- 2023ANPL: Towards Natural Programming with Interactive Decompositioncited by 13
- 2023Exploring the hierarchical structure of human plans via program generationcited by 12
- 2021Mitigating belief projection in explainable artificial intelligence via Bayesian Teachingcited by 10
- 2021Map Induction: Compositional spatial submap learning for efficient exploration in novel environmentscited by 9
- 2023Spiking Neural Networks and Bio-Inspired Supervised Deep Learning: A Surveycited by 8
- 2022Can Humans Do Less-Than-One-Shot Learning?cited by 7
- 2023Compositional diversity in visual concept learningcited by 7
- 2023Synaptic Plasticity Models and Bio-Inspired Unsupervised Deep Learning: A Surveycited by 7
11 more
- 2022Disentangling Abstraction from Statistical Pattern Matching in Human and Machine Learningcited by 6
- 2024Distilling Symbolic Priors for Concept Learning into Neural Networkscited by 5
- 2024TurtleBench: A Visual Programming Benchmark in Turtle Geometrycited by 4
- 2024Biologically-inspired Semi-supervised Semantic Segmentation for Biomedical Imagingcited by 4
- 2021Flexible Compositional Learning of Structured Visual Conceptscited by 2
- 2021Explainable AI for Natural Adversarial Imagescited by 2
- 2024Cross-Modal Few-Shot Learning: a Generative Transfer Learning Frameworkcited by 2
- 2025Cognitive maps are generative programscited by 2
- 2021Building Object-based Causal Programs for Human-like Generalizationcited by 0
- 2022A Probabilistic Generative Model of Free Categoriescited by 0
- 2025"Stop replacing salt with sugar!'': Towards Intuitive Human-Agent Teachingcited by 0
- 2025"Stop replacing salt with sugar!'': Towards Intuitive Human-Agent Teaching29 Sep 2025
- 2025PoE-World: Compositional World Modeling with Products of Programmatic Experts16 May 2025
- 2025Cognitive maps are generative programs29 Apr 2025
- 2024Biologically-inspired Semi-supervised Semantic Segmentation for Biomedical Imaging4 Dec 2024
- 2024TurtleBench: A Visual Programming Benchmark in Turtle Geometry31 Oct 2024
- 2024Cross-Modal Few-Shot Learning: a Generative Transfer Learning Framework14 Oct 2024
- 2024Distilling Symbolic Priors for Concept Learning into Neural Networks10 Feb 2024
- 2023SEVA: Leveraging sketches to evaluate alignment between human and machine visual abstraction5 Dec 2023
- 2023Exploring the hierarchical structure of human plans via program generation30 Nov 2023
- 2023Synaptic Plasticity Models and Bio-Inspired Unsupervised Deep Learning: A Survey30 Jul 2023
- 2023Spiking Neural Networks and Bio-Inspired Supervised Deep Learning: A Survey30 Jul 2023
- 2023Compositional diversity in visual concept learning30 May 2023
11 more
- 2023ANPL: Towards Natural Programming with Interactive Decomposition29 May 2023
- 2022A Probabilistic Generative Model of Free Categories9 May 2022
- 2022"This is my unicorn, Fluffy": Personalizing frozen vision-language representations4 Apr 2022
- 2022Disentangling Abstraction from Statistical Pattern Matching in Human and Machine Learning4 Apr 2022
- 2022Can Humans Do Less-Than-One-Shot Learning?9 Feb 2022
- 2021Building Object-based Causal Programs for Human-like Generalization20 Nov 2021
- 2021Map Induction: Compositional spatial submap learning for efficient exploration in novel environments23 Oct 2021
- 2021Explainable AI for Natural Adversarial Images16 Jun 2021
- 2021Communicating Natural Programs to Humans and Machines15 Jun 2021
- 2021Flexible Compositional Learning of Structured Visual Concepts20 May 2021
- 2021Mitigating belief projection in explainable artificial intelligence via Bayesian Teaching7 Feb 2021
- 2022"This is my unicorn, Fluffy": Personalizing frozen vision-language representationscited by 95
- 2021Communicating Natural Programs to Humans and Machinescited by 35
- 2023SEVA: Leveraging sketches to evaluate alignment between human and machine visual abstractioncited by 14
- 2023ANPL: Towards Natural Programming with Interactive Decompositioncited by 13
- 2023Exploring the hierarchical structure of human plans via program generationcited by 12
- 2021Mitigating belief projection in explainable artificial intelligence via Bayesian Teachingcited by 10
- 2021Map Induction: Compositional spatial submap learning for efficient exploration in novel environmentscited by 9
- 2023Spiking Neural Networks and Bio-Inspired Supervised Deep Learning: A Surveycited by 8
- 2022Can Humans Do Less-Than-One-Shot Learning?cited by 7
- 2023Compositional diversity in visual concept learningcited by 7
- 2023Synaptic Plasticity Models and Bio-Inspired Unsupervised Deep Learning: A Surveycited by 7
- 2022Disentangling Abstraction from Statistical Pattern Matching in Human and Machine Learningcited by 6
12 most cited of 22 All 22 (JSON)
- 2025"Stop replacing salt with sugar!'': Towards Intuitive Human-Agent Teaching29 Sep 2025
- 2025Cognitive maps are generative programs29 Apr 2025
- 2024Biologically-inspired Semi-supervised Semantic Segmentation for Biomedical Imaging4 Dec 2024
- 2024TurtleBench: A Visual Programming Benchmark in Turtle Geometry31 Oct 2024
- 2024Cross-Modal Few-Shot Learning: a Generative Transfer Learning Framework14 Oct 2024
- 2024Distilling Symbolic Priors for Concept Learning into Neural Networks10 Feb 2024
- 2023SEVA: Leveraging sketches to evaluate alignment between human and machine visual abstraction5 Dec 2023
- 2023Exploring the hierarchical structure of human plans via program generation30 Nov 2023
- 2023Synaptic Plasticity Models and Bio-Inspired Unsupervised Deep Learning: A Survey30 Jul 2023
- 2023Spiking Neural Networks and Bio-Inspired Supervised Deep Learning: A Survey30 Jul 2023
- 2023Compositional diversity in visual concept learning30 May 2023
- 2023ANPL: Towards Natural Programming with Interactive Decomposition29 May 2023
12 newest of 22 All 22 (JSON)