mlsanityData to 7 Oct 2026

A Survey on Machine Learning Approaches for Modelling Intuitive Physics

arXiv 2202.06481 ↗First posted 14 Feb 2022cs.LG cs.AIcited by 20

Not on the map. Why?

Abstract (arXiv)

Research in cognitive science has provided extensive evidence of human cognitive ability in performing physical reasoning of objects from noisy perceptual inputs. Such a cognitive ability is commonly known as intuitive physics. With advancements in deep learning, there is an increasing interest in building intelligent systems that are capable of performing physical reasoning from a given scene for the purpose of building better AI systems. As a result, many contemporary approaches in modelling intuitive physics for machine cognition have been inspired by literature from cognitive science. Despite the wide range of work in physical reasoning for machine cognition, there is a scarcity of reviews that organize and group these deep learning approaches. Especially at the intersection of intuitive physics and artificial intelligence, there is a need to make sense of the diverse range of ideas and approaches. Therefore, this paper presents a comprehensive survey of recent advances and techniques in intuitive physics-inspired deep learning approaches for physical reasoning. The survey will first categorize existing deep learning approaches into three facets of physical reasoning before organizing them into three general technical approaches and propose six categorical tasks of the field. Finally, we highlight the challenges of the current field and present some future research directions.

Key facts. Cited by 20 papers in the map (data through 7 Oct 2026). Builds on 32 of its 90 references that are in the map. First posted on arXiv 14 Feb 2022.

Builds on

32 of 90 references.

References · 32

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2014Going Deeper with Convolutionscited by 4,231
  3. 2016SqueezeNet: AlexNet-level accuracy with 50x fewer parameters and <0.5MB model sizecited by 1,054
  4. 2016Interaction Networks for Learning about Objects, Relations and Physicscited by 503
  5. 2019CLEVRER: CoLlision Events for Video REpresentation and Reasoningcited by 475
  6. 2021A Survey of Embodied AI: From Simulators to Research Taskscited by 256
  7. 2018Learning Particle Dynamics for Manipulating Rigid Bodies, Deformable Objects, and Fluidscited by 219
  8. 2021Physion: Evaluating Physical Prediction from Vision in Humans and Machinescited by 145
  9. 2019PHYRE: A New Benchmark for Physical Reasoningcited by 137
  10. 2016A Compositional Object-Based Approach to Learning Physical Dynamicscited by 119
  11. 2017Visual Interaction Networkscited by 94
  12. 2018Flexible Neural Representation for Physics Predictioncited by 91
20 more
  1. 2019CoPhy: Counterfactual Learning of Physical Dynamicscited by 80
  2. 2018IntPhys: A Framework and Benchmark for Visual Intuitive Physics Reasoningcited by 72
  3. 2016Learning Physical Intuition of Block Towers by Examplecited by 66
  4. 2015Learning Visual Predictive Models of Physics for Playing Billiardscited by 58
  5. 2018ShapeStacks: Learning Vision-Based Physical Intuition for Generalised Object Stackingcited by 55
  6. 2020Visual Grounding of Learned Physical Modelscited by 54
  7. 2018Reasoning About Physical Interactions with Object-Oriented Prediction and Planningcited by 51
  8. 2020CRAFT: A Benchmark for Causal Reasoning About Forces and inTeractionscited by 44
  9. 2019Physics-as-Inverse-Graphics: Unsupervised Physical Parameter Estimation from Videocited by 43
  10. 2020Learning 3D Dynamic Scene Representations for Robot Manipulationcited by 39
  11. 2015Newtonian Image Understanding: Unfolding the Dynamics of Objects in Static Imagescited by 26
  12. 2018Interpretable Intuitive Physics Modelcited by 19
  13. 2020Causal World Models by Unsupervised Deconfounding of Physical Dynamicscited by 14
  14. 2018Unsupervised Learning of Latent Physical Properties Using Perception-Prediction Networkscited by 13
  15. 2018Probing Physics Knowledge Using Tools from Developmental Psychologycited by 12
  16. 2016To Fall Or Not To Fall: A Visual Approach to Physical Stability Predictioncited by 10
  17. 2021A Benchmark for Modeling Violation-of-Expectation in Physical Reasoning Across Event Categoriescited by 8
  18. 2019Inferring 3D Shapes of Unknown Rigid Objects in Clutter through Inverse Physics Reasoningcited by 3
  19. 2018Perceiving Physical Equation by Observing Visual Scenarioscited by 2
  20. 2019Unsupervised Intuitive Physics from Past Experiencescited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2022: 2; 2023: 5; 2024: 7; 2025: 3; 2026: 3.

20 papers.

Sort:

By area:

  1. 2024RoboPoint: A Vision-Language Model for Spatial Affordance Prediction for Roboticscited by 242
  2. 2024VideoPhy: Evaluating Physical Commonsense for Video Generationcited by 215
  3. 2025VideoPhy-2: A Challenging Action-Centric Physical Commonsense Evaluation in Video Generationcited by 141
  4. 2022Physics-Informed Machine Learning: A Survey on Problems, Methods and Applicationscited by 88
  5. 2024Neural Material Adaptor for Visual Grounding of Intrinsic Dynamicscited by 30
  6. 2023GRASP: A novel benchmark for evaluating language GRounding And Situated Physics understanding in multimodal language modelscited by 28
  7. 2023I-PHYRE: Interactive Physical Reasoningcited by 15
  8. 2026VLS: Steering Pretrained Robot Policies via Vision-Language Modelscited by 14
  9. 2023Benchmarks for Physical Reasoning AIcited by 8
  10. 2022Neuro-Symbolic Learning: Principles and Applications in Ophthalmologycited by 7
  11. 2024FORCE: Physics-aware Human-object Interactioncited by 7
  12. 2023A Survey of Methods, Challenges and Perspectives in Causalitycited by 6
8 more
  1. 2023The Acquisition of Physical Knowledge in Generative Neural Networkscited by 3
  2. 2025Aligning Perception, Reasoning, Modeling and Interaction: A Survey on Physical AIcited by 3
  3. 2024Learning Physical Dynamics for Object-centric Visual Predictioncited by 1
  4. 2026Order from Chaos: Physical World Understanding from Glitchy Gameplay Videoscited by 1
  5. 2024Transformers and Slot Encoding for Sample Efficient Physical World Modellingcited by 0
  6. 2024Interpretable Representation Learning from Videos using Nonlinear Priorscited by 0
  7. 2025Towards aligned body representations in vision modelscited by 0
  8. 2026Analytic Dynamics: Learning Physics-Grounded Representation for Fast Intrinsic Dynamics Inference from Monocular Videoscited by 0