mlsanityData to 7 Oct 2026

How much human-like visual experience do current self-supervised learning algorithms need in order to achieve human-level object recognition?

arXiv 2109.11523 ↗First posted 23 Sep 2021cs.CV cs.LG cs.NEcited by 4

Not on the map. Why?

Abstract (arXiv)

This paper addresses a fundamental question: how good are our current self-supervised visual representation learning algorithms relative to humans? More concretely, how much "human-like" natural visual experience would these algorithms need in order to reach human-level performance in a complex, realistic visual object recognition task such as ImageNet? Using a scaling experiment, here we estimate that the answer is several orders of magnitude longer than a human lifetime: typically on the order of a million to a billion years of natural visual experience (depending on the algorithm used). We obtain even larger estimates for achieving human-level performance in ImageNet-derived robustness benchmarks. The exact values of these estimates are sensitive to some underlying assumptions, however even in the most optimistic scenarios they remain orders of magnitude larger than a human lifetime. We discuss the main caveats surrounding our estimates and the implications of these surprising results.

Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 14 of its 23 references that are in the map. First posted on arXiv 23 Sep 2021.

Builds on

14 of 23 references.

References · 14

  1. 2020Language Models are Few-Shot Learnerscited by 32,199
  2. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
  3. 2014ImageNet Large Scale Visual Recognition Challengecited by 8,441
  4. 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
  5. 2020Bootstrap your own latent: A new approach to self-supervised Learningcited by 4,712
  6. 2021Zero-Shot Text-to-Image Generationcited by 4,276
  7. 2019Self-training with Noisy Student improves ImageNet classificationcited by 1,304
  8. 2018Scaling Egocentric Vision: The EPIC-KITCHENS Datasetcited by 789
  9. 2017AVA: A Video Dataset of Spatio-temporally Localized Atomic Visual Actionscited by 449
  10. 2020The Next Decade in AI: Four Steps Towards Robust Artificial Intelligencecited by 194
  11. 2021Partial success in closing the gap between human and machine visioncited by 185
  12. 2017Building machines that adapt and compute like brainscited by 99
2 more
  1. 2020A Short Note on the Kinetics-700-2020 Human Action Datasetcited by 89
  2. 2020Self-supervised learning through the eyes of a childcited by 61

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 1; 2024: 2; 2025: 0; 2026: 1.

4 papers.