mlsanityData to 7 Oct 2026

Learning from One and Only One Shot

arXiv 2201.08815 ↗First posted 14 Jan 2022cs.CV cs.AIcited by 4

Not on the map. Why?

Abstract (arXiv)

Humans can generalize from only a few examples and from little pretraining on similar tasks. Yet, machine learning (ML) typically requires large data to learn or pre-learn to transfer. Motivated by nativism and artificial general intelligence, we directly model human-innate priors in abstract visual tasks such as character and doodle recognition. This yields a white-box model that learns general-appearance similarity by mimicking how humans naturally ``distort'' an object at first sight. Using just nearest-neighbor classification on this cognitively-inspired similarity space, we achieve human-level recognition with only 1--10 examples per class and no pretraining. This differs from few-shot learning that uses massive pretraining. In the tiny-data regime of MNIST, EMNIST, Omniglot, and QuickDraw benchmarks, we outperform both modern neural networks and classical ML. For unsupervised learning, by learning the non-Euclidean, general-appearance similarity space in a k-means style, we achieve multifarious visual realizations of abstract concepts by generating human-intuitive archetypes as cluster centroids.

Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 12 of its 48 references that are in the map. First posted on arXiv 14 Jan 2022.

Builds on

12 of 48 references.

References · 12

  1. 2020Language Models are Few-Shot Learnerscited by 32,199
  2. 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,861
  3. 2016Geometric deep learning: going beyond Euclidean datacited by 1,042
  4. 2019Big Transfer (BiT): General Visual Representation Learningcited by 766
  5. 2015Holistically-Nested Edge Detectioncited by 590
  6. 2013Fast Computation of Wasserstein Barycenterscited by 216
  7. 2017EMNIST: an extension of MNIST to handwritten letterscited by 212
  8. 2018Unsupervised Learning via Meta-Learningcited by 81
  9. 2019Doodle to Search: Practical Zero-Shot Sketch-based Image Retrievalcited by 79
  10. 2019The Omniglot challenge: a 3-year progress reportcited by 54
  11. 2019TextCaps : Handwritten Character Recognition with Very Small Datasetscited by 9
  12. 2018One-Shot Learning using Mixture of Variational Autoencoders: a Generalization Learning approachcited by 3

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 1; 2026: 3.

4 papers.