How much human-like visual experience do current self-supervised learning algorithms need in order to achieve human-level object recognition?
Not on the map. Why?
Abstract (arXiv)
This paper addresses a fundamental question: how good are our current self-supervised visual representation learning algorithms relative to humans? More concretely, how much "human-like" natural visual experience would these algorithms need in order to reach human-level performance in a complex, realistic visual object recognition task such as ImageNet? Using a scaling experiment, here we estimate that the answer is several orders of magnitude longer than a human lifetime: typically on the order of a million to a billion years of natural visual experience (depending on the algorithm used). We obtain even larger estimates for achieving human-level performance in ImageNet-derived robustness benchmarks. The exact values of these estimates are sensitive to some underlying assumptions, however even in the most optimistic scenarios they remain orders of magnitude larger than a human lifetime. We discuss the main caveats surrounding our estimates and the implications of these surprising results.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 14 of its 23 references that are in the map. First posted on arXiv 23 Sep 2021.
Builds on
14 of 23 references.
References · 14
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
- 2014ImageNet Large Scale Visual Recognition Challengecited by 8,441
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
- 2020Bootstrap your own latent: A new approach to self-supervised Learningcited by 4,712
- 2021Zero-Shot Text-to-Image Generationcited by 4,276
- 2019Self-training with Noisy Student improves ImageNet classificationcited by 1,304
- 2018Scaling Egocentric Vision: The EPIC-KITCHENS Datasetcited by 789
- 2017AVA: A Video Dataset of Spatio-temporally Localized Atomic Visual Actionscited by 449
- 2020The Next Decade in AI: Four Steps Towards Robust Artificial Intelligencecited by 194
- 2021Partial success in closing the gap between human and machine visioncited by 185
- 2017Building machines that adapt and compute like brainscited by 99
2 more
- 2020A Short Note on the Kinetics-700-2020 Human Action Datasetcited by 89
- 2020Self-supervised learning through the eyes of a childcited by 61
Built on by
Citing papers per year: 2023: 1; 2024: 2; 2025: 0; 2026: 1.
4 papers.
- 2024The BabyView dataset: High-resolution egocentric videos of infants' and young children's everyday experiencescited by 15
- 2023Scaling may be all you need for achieving human-level object recognition capacity with human-like visual experiencecited by 4
- 2024Comparing supervised learning dynamics: Deep neural networks match human data efficiency but show a generalisation lagcited by 0
- 2026Characterizing the visual representation of objects from the child's viewcited by 0
- 2026Characterizing the visual representation of objects from the child's view14 May 2026
- 2024The BabyView dataset: High-resolution egocentric videos of infants' and young children's everyday experiences14 Jun 2024
- 2024Comparing supervised learning dynamics: Deep neural networks match human data efficiency but show a generalisation lag14 Feb 2024
- 2023Scaling may be all you need for achieving human-level object recognition capacity with human-like visual experience7 Aug 2023