mlsanityData to 14 Oct 2026

Aligning Perception, Reasoning, Modeling and Interaction: A Survey on Physical AI

arXiv 2510.04978 ↗First posted 6 Oct 2025cs.AIcited by 3

On the map: World models → Latent predictive world models

Abstract (arXiv)

The rapid advancement of embodied intelligence and world models has intensified efforts to integrate physical laws into AI systems, yet physical perception and symbolic physics reasoning have developed along separate trajectories without a unified bridging framework. This work provides a comprehensive overview of physical AI, establishing clear distinctions between theoretical physics reasoning and applied physical understanding while systematically examining how physics-grounded methods enhance AI's real-world comprehension across structured symbolic reasoning, embodied systems, and generative models. Through rigorous analysis of recent advances, we advocate for intelligent systems that ground learning in both physical principles and embodied reasoning processes, transcending pattern recognition toward genuine understanding of physical laws. Our synthesis envisions next-generation world models capable of explaining physical phenomena and predicting future states, advancing safe, generalizable, and interpretable AI systems. We maintain a continuously updated resource at https://github.com/AI4Phys/Awesome-AI-for-Physics.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Placed in Latent predictive world models, one of 11 directions in World models. Builds on 333 of its 439 references that are in the map. First posted on arXiv 6 Oct 2025.

Builds on

333 of 439 references.

Closest ancestors · 2

Same direction, newest first

  1. 2025A Survey on World Models Grounded in Acoustic Physical Information16 Jun
  2. 2024How Far is Video Generation from World Model: A Physical Law Perspective4 Nov

Other references · 331

  1. 2017Attention Is All You Needcited by 60,361
  2. 2014Microsoft COCO: Common Objects in Contextcited by 17,608
  3. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
  4. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,361
  5. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  6. 2017Graph Attention Networkscited by 8,923
  7. 2023Visual Instruction Tuningcited by 7,869
  8. 2017Mask R-CNNcited by 7,277
  9. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
  10. 2017Inductive Representation Learning on Large Graphscited by 6,320
  11. 2022Flow Matching for Generative Modelingcited by 5,702
  12. 2025Qwen2.5-VL Technical Reportcited by 5,587
38 more
  1. 2024GPT-4o System Cardcited by 4,588
  2. 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,523
  3. 2016The Cityscapes Dataset for Semantic Urban Scene Understandingcited by 4,444
  4. 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,234
  5. 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,332
  6. 2017Quo Vadis, Action Recognition? A New Model and the Kinetics Datasetcited by 3,270
  7. 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 3,080
  8. 2017Progressive Growing of GANs for Improved Quality, Stability, and Variationcited by 2,988
  9. 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,887
  10. 2023GPQA: A Graduate-Level Google-Proof Q&A Benchmarkcited by 2,879
  11. 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,838
  12. 2022Emergent Abilities of Large Language Modelscited by 2,512
  13. 2019Scalability in Perception for Autonomous Driving: Waymo Open Datasetcited by 2,451
  14. 2017CARLA: An Open Urban Driving Simulatorcited by 2,449
  15. 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,424
  16. 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,407
  17. 2022Do As I Can, Not As I Say: Grounding Language in Robotic Affordancescited by 2,348
  18. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
  19. 2023A Survey on Large Language Model based Autonomous Agentscited by 2,242
  20. 2023MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGIcited by 2,080
  21. 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,061
  22. 2022Learn to Explain: Multimodal Reasoning via Thought Chains for Science Question Answeringcited by 1,919
  23. 2017The Kinetics Human Action Video Datasetcited by 1,909
  24. 2023MME: A Comprehensive Evaluation Benchmark for Multimodal Large Language Modelscited by 1,652
  25. 2018World Modelscited by 1,513
  26. 2024Octo: An Open-Source Generalist Robot Policycited by 1,484
  27. 2016CLEVR: A Diagnostic Dataset for Compositional Language and Elementary Visual Reasoningcited by 1,457
  28. 2017Matterport3D: Learning from RGB-D Data in Indoor Environmentscited by 1,376
  29. 2018BDD100K: A Diverse Driving Dataset for Heterogeneous Multitask Learningcited by 1,288
  30. 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,225
  31. 2019Meta-World: A Benchmark and Evaluation for Multi-Task and Meta Reinforcement Learningcited by 1,204
  32. 2024OlympiadBench: A Challenging Benchmark for Promoting AGI with Olympiad-Level Bilingual Multimodal Scientific Problemscited by 1,136
  33. 2017The "something something" video database for learning and evaluating visual common sensecited by 1,103
  34. 2024Qwen2.5-Math Technical Report: Toward Mathematical Expert Model via Self-Improvementcited by 1,090
  35. 2024The AI Scientist: Towards Fully Automated Open-Ended Scientific Discoverycited by 1,071
  36. 2024Tulu 3: Pushing Frontiers in Open Language Model Post-Trainingcited by 1,053
  37. 2017Vision-and-Language Navigation: Interpreting visually-grounded navigation instructions in real environmentscited by 1,027
  38. 2016End to End Learning for Self-Driving Carscited by 1,009

50 most cited of 331 All 331 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 3.

3 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Cosmos-Reason1: From Physical Common Sense To Embodied Reasoning
  2. 2026Decoupled Physical Modeling and Execution for Physics Reasoning
  3. 2025WoW: Towards a World omniscient World model Through Embodied Interaction
  4. 2025PhysBench: Benchmarking and Enhancing Vision-Language Models for Physical World Understanding
  5. 2025Neural Force Field: Few-shot Learning of Generalized Physical Reasoning
  6. 2026PhysMent: An Interactive Approach For LLM Reasoning In Physics Problems
  7. 2026PhysicsMind: Sim and Real Mechanics Benchmarking for Physical Reasoning and Prediction in Foundational VLMs and World Models
  8. 2025Can Theoretical Physics Research Benefit from Language Agents?