Learning from One and Only One Shot
Not on the map. Why?
Abstract (arXiv)
Humans can generalize from only a few examples and from little pretraining on similar tasks. Yet, machine learning (ML) typically requires large data to learn or pre-learn to transfer. Motivated by nativism and artificial general intelligence, we directly model human-innate priors in abstract visual tasks such as character and doodle recognition. This yields a white-box model that learns general-appearance similarity by mimicking how humans naturally ``distort'' an object at first sight. Using just nearest-neighbor classification on this cognitively-inspired similarity space, we achieve human-level recognition with only 1--10 examples per class and no pretraining. This differs from few-shot learning that uses massive pretraining. In the tiny-data regime of MNIST, EMNIST, Omniglot, and QuickDraw benchmarks, we outperform both modern neural networks and classical ML. For unsupervised learning, by learning the non-Euclidean, general-appearance similarity space in a k-means style, we achieve multifarious visual realizations of abstract concepts by generating human-intuitive archetypes as cluster centroids.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 12 of its 48 references that are in the map. First posted on arXiv 14 Jan 2022.
Builds on
12 of 48 references.
References · 12
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,861
- 2016Geometric deep learning: going beyond Euclidean datacited by 1,042
- 2019Big Transfer (BiT): General Visual Representation Learningcited by 766
- 2015Holistically-Nested Edge Detectioncited by 590
- 2013Fast Computation of Wasserstein Barycenterscited by 216
- 2017EMNIST: an extension of MNIST to handwritten letterscited by 212
- 2018Unsupervised Learning via Meta-Learningcited by 81
- 2019Doodle to Search: Practical Zero-Shot Sketch-based Image Retrievalcited by 79
- 2019The Omniglot challenge: a 3-year progress reportcited by 54
- 2019TextCaps : Handwritten Character Recognition with Very Small Datasetscited by 9
- 2018One-Shot Learning using Mixture of Variational Autoencoders: a Generalization Learning approachcited by 3
Built on by
Citing papers per year: 2025: 1; 2026: 3.
4 papers.
- 2026SepSeq: A Training-Free Framework for Long Numerical Sequence Processing in LLMscited by 1
- 2025Advancing site-specific disease and pest management in precision agriculture: From reasoning-driven foundation models to adaptive, feedback-based learningcited by 0
- 2026Information Lattice Learning as Probabilistic Graphical Model Structure Learningcited by 0
- 2026Hidden-Shot: Towards One-Shot Task Generalization for Low-Level Vision Generalist Modelscited by 0
- 2026Hidden-Shot: Towards One-Shot Task Generalization for Low-Level Vision Generalist Models1 Jul 2026
- 2026Information Lattice Learning as Probabilistic Graphical Model Structure Learning11 Jun 2026
- 2026SepSeq: A Training-Free Framework for Long Numerical Sequence Processing in LLMs9 Apr 2026
- 2025Advancing site-specific disease and pest management in precision agriculture: From reasoning-driven foundation models to adaptive, feedback-based learning28 Oct 2025