mlsanityData to 7 Oct 2026

Interpretable Intuitive Physics Model

arXiv 1808.10002 ↗First posted 29 Aug 2018cs.CVcited by 19

Not on the map. Why?

Abstract (arXiv)

Humans have a remarkable ability to use physical commonsense and predict the effect of collisions. But do they understand the underlying factors? Can they predict if the underlying factors have changed? Interestingly, in most cases humans can predict the effects of similar collisions with different conditions such as changes in mass, friction, etc. It is postulated this is primarily because we learn to model physics with meaningful latent variables. This does not imply we can estimate the precise values of these meaningful variables (estimate exact values of mass or friction). Inspired by this observation, we propose an interpretable intuitive physics model where specific dimensions in the bottleneck layers correspond to different physical properties. In order to demonstrate that our system models these underlying physical properties, we train our model on collisions of different shapes (cube, cone, cylinder, spheres etc.) and test on collisions of unseen combinations of shapes. Furthermore, we demonstrate our model generalizes well even when similar scenes are simulated with different underlying properties.

Key facts. Cited by 19 papers in the map (data through 7 Oct 2026). First posted on arXiv 29 Aug 2018.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 8; 2022: 8; 2023: 0; 2024: 1; 2025: 1; 2026: 1.

19 papers.

Sort:

By area:

  1. 2022Physics-Informed Machine Learning: A Survey on Problems, Methods and Applicationscited by 88
  2. 2021Grounding Physical Concepts of Objects and Events Through Dynamic Visual Reasoningcited by 68
  3. 2022When Physics Meets Machine Learning: A Survey of Physics-Informed Machine Learningcited by 64
  4. 2021Dynamic Visual Reasoning by Learning Differentiable Physics Models from Video and Languagecited by 55
  5. 2021Video Autoencoder: self-supervised disentanglement of static 3D structure and motioncited by 34
  6. 2022Doubly Right Object Recognition: A Why Prompt for Visual Rationalescited by 29
  7. 2021Towards a Collective Agenda on AI for Earth Science Data Analysiscited by 27
  8. 2024PhysGame: Uncovering Physical Commonsense Violations in Gameplay Videoscited by 21
  9. 2022A Survey on Machine Learning Approaches for Modelling Intuitive Physicscited by 20
  10. 2021PIP: Physical Interaction Prediction via Mental Simulation with Span Selectioncited by 8
  11. 2021VDSM: Unsupervised Video Disentanglement with State-Space Modeling and Deep Mixtures of Expertscited by 6
  12. 2022Pretraining on Interactions for Learning Grounded Affordance Representationscited by 5
7 more
  1. 2022Compositional Law Parsing with Latent Random Functionscited by 3
  2. 2022Distilling Governing Laws and Source Input for Dynamical Systems from Videoscited by 2
  3. 2025Causal-PIK: Causality-based Physical Reasoning with a Physics-Informed Kernelcited by 2
  4. 2021Uncovering Closed-form Governing Equations of Nonlinear Dynamics from Videoscited by 1
  5. 2022T3VIP: Transformation-based 3D Video Predictioncited by 1
  6. 2026Emergent Compositional Communication for Latent World Propertiescited by 1
  7. 2021Understanding in Artificial Intelligencecited by 0