The Acquisition of Physical Knowledge in Generative Neural Networks
Not on the map. Why?
Abstract (arXiv)
As children grow older, they develop an intuitive understanding of the physical processes around them. Their physical understanding develops in stages, moving along developmental trajectories which have been mapped out extensively in previous empirical research. Here, we investigate how the learning trajectories of deep generative neural networks compare to children's developmental trajectories using physical understanding as a testbed. We outline an approach that allows us to examine two distinct hypotheses of human development - stochastic optimization and complexity increase. We find that while our models are able to accurately predict a number of physical processes, their learning trajectories under both hypotheses do not follow the developmental trajectories of children.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 19 of its 45 references that are in the map. First posted on arXiv 30 Oct 2023.
Builds on
19 of 45 references.
References · 19
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
- 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,058
- 2022Generative Adversarial Networkscited by 5,627
- 2018ImageNet-trained CNNs are biased towards texture; increasing shape bias improves accuracy and robustnesscited by 1,432
- 2018Learning Latent Dynamics for Planning from Pixelscited by 1,264
- 2016Interaction Networks for Learning about Objects, Relations and Physicscited by 509
- 2022Using cognitive psychology to understand GPT-3cited by 398
- 2018IntPhys: A Framework and Benchmark for Visual Intuitive Physics Reasoningcited by 73
- 2016Learning Physical Intuition of Block Towers by Examplecited by 68
- 2020On the Transfer of Disentangled Representations in Realistic Settingscited by 63
7 more
- 2017Cognitive Psychology for Deep Neural Networks: A Shape Bias Case Studycited by 46
- 2021Clockwork Variational Autoencoderscited by 42
- 2022A Survey on Machine Learning Approaches for Modelling Intuitive Physicscited by 20
- 2018Probing Physics Knowledge Using Tools from Developmental Psychologycited by 12
- 2016A Comparative Evaluation of Approximate Probabilistic Simulation and Deep Neural Networks as Accounts of Human Physical Scene Understandingcited by 9
- 2022The developmental trajectory of object recognition robustness: children are like small adults but unlike big deep neural networkscited by 9
- 2019Emulating Human Developmental Stages with Bayesian Neural Networkscited by 2
Built on by
Citing papers per year: 2023: 1; 2024: 1; 2025: 0; 2026: 1.
3 papers.