Interpretable Intuitive Physics Model
Not on the map. Why?
Abstract (arXiv)
Humans have a remarkable ability to use physical commonsense and predict the effect of collisions. But do they understand the underlying factors? Can they predict if the underlying factors have changed? Interestingly, in most cases humans can predict the effects of similar collisions with different conditions such as changes in mass, friction, etc. It is postulated this is primarily because we learn to model physics with meaningful latent variables. This does not imply we can estimate the precise values of these meaningful variables (estimate exact values of mass or friction). Inspired by this observation, we propose an interpretable intuitive physics model where specific dimensions in the bottleneck layers correspond to different physical properties. In order to demonstrate that our system models these underlying physical properties, we train our model on collisions of different shapes (cube, cone, cylinder, spheres etc.) and test on collisions of unseen combinations of shapes. Furthermore, we demonstrate our model generalizes well even when similar scenes are simulated with different underlying properties.
Key facts. Cited by 19 papers in the map (data through 7 Oct 2026). First posted on arXiv 29 Aug 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 8; 2022: 8; 2023: 0; 2024: 1; 2025: 1; 2026: 1.
19 papers.
Sort:
By area:
- 2022Physics-Informed Machine Learning: A Survey on Problems, Methods and Applicationscited by 88
- 2021Grounding Physical Concepts of Objects and Events Through Dynamic Visual Reasoningcited by 68
- 2022When Physics Meets Machine Learning: A Survey of Physics-Informed Machine Learningcited by 64
- 2021Dynamic Visual Reasoning by Learning Differentiable Physics Models from Video and Languagecited by 55
- 2021Video Autoencoder: self-supervised disentanglement of static 3D structure and motioncited by 34
- 2022Doubly Right Object Recognition: A Why Prompt for Visual Rationalescited by 29
- 2021Towards a Collective Agenda on AI for Earth Science Data Analysiscited by 27
- 2024PhysGame: Uncovering Physical Commonsense Violations in Gameplay Videoscited by 21
- 2022A Survey on Machine Learning Approaches for Modelling Intuitive Physicscited by 20
- 2021PIP: Physical Interaction Prediction via Mental Simulation with Span Selectioncited by 8
- 2021VDSM: Unsupervised Video Disentanglement with State-Space Modeling and Deep Mixtures of Expertscited by 6
- 2022Pretraining on Interactions for Learning Grounded Affordance Representationscited by 5
7 more
- 2022Compositional Law Parsing with Latent Random Functionscited by 3
- 2022Distilling Governing Laws and Source Input for Dynamical Systems from Videoscited by 2
- 2025Causal-PIK: Causality-based Physical Reasoning with a Physics-Informed Kernelcited by 2
- 2021Uncovering Closed-form Governing Equations of Nonlinear Dynamics from Videoscited by 1
- 2022T3VIP: Transformation-based 3D Video Predictioncited by 1
- 2026Emergent Compositional Communication for Latent World Propertiescited by 1
- 2021Understanding in Artificial Intelligencecited by 0
- 2026Emergent Compositional Communication for Latent World Properties18 Mar 2026
- 2025Causal-PIK: Causality-based Physical Reasoning with a Physics-Informed Kernel28 May 2025
- 2024PhysGame: Uncovering Physical Commonsense Violations in Gameplay Videos2 Dec 2024
- 2022Doubly Right Object Recognition: A Why Prompt for Visual Rationales12 Dec 2022
- 2022Physics-Informed Machine Learning: A Survey on Problems, Methods and Applications15 Nov 2022
- 2022T3VIP: Transformation-based 3D Video Prediction19 Sep 2022
- 2022Compositional Law Parsing with Latent Random Functions15 Sep 2022
- 2022Pretraining on Interactions for Learning Grounded Affordance Representations5 Jul 2022
- 2022Distilling Governing Laws and Source Input for Dynamical Systems from Videos3 May 2022
- 2022When Physics Meets Machine Learning: A Survey of Physics-Informed Machine Learning31 Mar 2022
- 2022A Survey on Machine Learning Approaches for Modelling Intuitive Physics14 Feb 2022
- 2021Dynamic Visual Reasoning by Learning Differentiable Physics Models from Video and Language28 Oct 2021
7 more
- 2021Video Autoencoder: self-supervised disentanglement of static 3D structure and motion6 Oct 2021
- 2021PIP: Physical Interaction Prediction via Mental Simulation with Span Selection10 Sep 2021
- 2021Uncovering Closed-form Governing Equations of Nonlinear Dynamics from Videos9 Jun 2021
- 2021Towards a Collective Agenda on AI for Earth Science Data Analysis11 Apr 2021
- 2021Grounding Physical Concepts of Objects and Events Through Dynamic Visual Reasoning30 Mar 2021
- 2021VDSM: Unsupervised Video Disentanglement with State-Space Modeling and Deep Mixtures of Experts12 Mar 2021
- 2021Understanding in Artificial Intelligence17 Jan 2021
- 2022Physics-Informed Machine Learning: A Survey on Problems, Methods and Applicationscited by 88
- 2021Grounding Physical Concepts of Objects and Events Through Dynamic Visual Reasoningcited by 68
- 2022When Physics Meets Machine Learning: A Survey of Physics-Informed Machine Learningcited by 64
- 2021Dynamic Visual Reasoning by Learning Differentiable Physics Models from Video and Languagecited by 55
- 2021Video Autoencoder: self-supervised disentanglement of static 3D structure and motioncited by 34
- 2022Doubly Right Object Recognition: A Why Prompt for Visual Rationalescited by 29
- 2021Towards a Collective Agenda on AI for Earth Science Data Analysiscited by 27
- 2024PhysGame: Uncovering Physical Commonsense Violations in Gameplay Videoscited by 21
- 2022A Survey on Machine Learning Approaches for Modelling Intuitive Physicscited by 20
- 2021PIP: Physical Interaction Prediction via Mental Simulation with Span Selectioncited by 8
- 2022Pretraining on Interactions for Learning Grounded Affordance Representationscited by 5
- 2022Compositional Law Parsing with Latent Random Functionscited by 3
12 most cited of 18 All 18 (JSON)
- 2026Emergent Compositional Communication for Latent World Properties18 Mar 2026
- 2025Causal-PIK: Causality-based Physical Reasoning with a Physics-Informed Kernel28 May 2025
- 2024PhysGame: Uncovering Physical Commonsense Violations in Gameplay Videos2 Dec 2024
- 2022Doubly Right Object Recognition: A Why Prompt for Visual Rationales12 Dec 2022
- 2022Physics-Informed Machine Learning: A Survey on Problems, Methods and Applications15 Nov 2022
- 2022T3VIP: Transformation-based 3D Video Prediction19 Sep 2022
- 2022Compositional Law Parsing with Latent Random Functions15 Sep 2022
- 2022Pretraining on Interactions for Learning Grounded Affordance Representations5 Jul 2022
- 2022Distilling Governing Laws and Source Input for Dynamical Systems from Videos3 May 2022
- 2022When Physics Meets Machine Learning: A Survey of Physics-Informed Machine Learning31 Mar 2022
- 2022A Survey on Machine Learning Approaches for Modelling Intuitive Physics14 Feb 2022
- 2021Dynamic Visual Reasoning by Learning Differentiable Physics Models from Video and Language28 Oct 2021
12 newest of 18 All 18 (JSON)