Aligning Perception, Reasoning, Modeling and Interaction: A Survey on Physical AI
On the map: World models → Latent predictive world models
Abstract (arXiv)
The rapid advancement of embodied intelligence and world models has intensified efforts to integrate physical laws into AI systems, yet physical perception and symbolic physics reasoning have developed along separate trajectories without a unified bridging framework. This work provides a comprehensive overview of physical AI, establishing clear distinctions between theoretical physics reasoning and applied physical understanding while systematically examining how physics-grounded methods enhance AI's real-world comprehension across structured symbolic reasoning, embodied systems, and generative models. Through rigorous analysis of recent advances, we advocate for intelligent systems that ground learning in both physical principles and embodied reasoning processes, transcending pattern recognition toward genuine understanding of physical laws. Our synthesis envisions next-generation world models capable of explaining physical phenomena and predicting future states, advancing safe, generalizable, and interpretable AI systems. We maintain a continuously updated resource at https://github.com/AI4Phys/Awesome-AI-for-Physics.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Placed in Latent predictive world models, one of 11 directions in World models. Builds on 333 of its 439 references that are in the map. First posted on arXiv 6 Oct 2025.
Builds on
333 of 439 references.
Closest ancestors · 2
Same direction, newest first
- 2025A Survey on World Models Grounded in Acoustic Physical Information16 Jun
- 2024How Far is Video Generation from World Model: A Physical Law Perspective4 Nov
Other references · 331
- 2017Attention Is All You Needcited by 60,361
- 2014Microsoft COCO: Common Objects in Contextcited by 17,608
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,361
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2017Graph Attention Networkscited by 8,923
- 2023Visual Instruction Tuningcited by 7,869
- 2017Mask R-CNNcited by 7,277
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
- 2017Inductive Representation Learning on Large Graphscited by 6,320
- 2022Flow Matching for Generative Modelingcited by 5,702
- 2025Qwen2.5-VL Technical Reportcited by 5,587
38 more
- 2024GPT-4o System Cardcited by 4,588
- 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,523
- 2016The Cityscapes Dataset for Semantic Urban Scene Understandingcited by 4,444
- 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,234
- 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,332
- 2017Quo Vadis, Action Recognition? A New Model and the Kinetics Datasetcited by 3,270
- 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 3,080
- 2017Progressive Growing of GANs for Improved Quality, Stability, and Variationcited by 2,988
- 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,887
- 2023GPQA: A Graduate-Level Google-Proof Q&A Benchmarkcited by 2,879
- 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,838
- 2022Emergent Abilities of Large Language Modelscited by 2,512
- 2019Scalability in Perception for Autonomous Driving: Waymo Open Datasetcited by 2,451
- 2017CARLA: An Open Urban Driving Simulatorcited by 2,449
- 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,424
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,407
- 2022Do As I Can, Not As I Say: Grounding Language in Robotic Affordancescited by 2,348
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
- 2023A Survey on Large Language Model based Autonomous Agentscited by 2,242
- 2023MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGIcited by 2,080
- 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,061
- 2022Learn to Explain: Multimodal Reasoning via Thought Chains for Science Question Answeringcited by 1,919
- 2017The Kinetics Human Action Video Datasetcited by 1,909
- 2023MME: A Comprehensive Evaluation Benchmark for Multimodal Large Language Modelscited by 1,652
- 2018World Modelscited by 1,513
- 2024Octo: An Open-Source Generalist Robot Policycited by 1,484
- 2016CLEVR: A Diagnostic Dataset for Compositional Language and Elementary Visual Reasoningcited by 1,457
- 2017Matterport3D: Learning from RGB-D Data in Indoor Environmentscited by 1,376
- 2018BDD100K: A Diverse Driving Dataset for Heterogeneous Multitask Learningcited by 1,288
- 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,225
- 2019Meta-World: A Benchmark and Evaluation for Multi-Task and Meta Reinforcement Learningcited by 1,204
- 2024OlympiadBench: A Challenging Benchmark for Promoting AGI with Olympiad-Level Bilingual Multimodal Scientific Problemscited by 1,136
- 2017The "something something" video database for learning and evaluating visual common sensecited by 1,103
- 2024Qwen2.5-Math Technical Report: Toward Mathematical Expert Model via Self-Improvementcited by 1,090
- 2024The AI Scientist: Towards Fully Automated Open-Ended Scientific Discoverycited by 1,071
- 2024Tulu 3: Pushing Frontiers in Open Language Model Post-Trainingcited by 1,053
- 2017Vision-and-Language Navigation: Interpreting visually-grounded navigation instructions in real environmentscited by 1,027
- 2016End to End Learning for Self-Driving Carscited by 1,009
50 most cited of 331 All 331 (JSON)
Built on by
Citing papers per year: 2026: 3.
3 papers.
Similar, not cited
Close in wording, no citation either way
- 2025Cosmos-Reason1: From Physical Common Sense To Embodied Reasoning
- 2026Decoupled Physical Modeling and Execution for Physics Reasoning
- 2025WoW: Towards a World omniscient World model Through Embodied Interaction
- 2025PhysBench: Benchmarking and Enhancing Vision-Language Models for Physical World Understanding
- 2025Neural Force Field: Few-shot Learning of Generalized Physical Reasoning
- 2026PhysMent: An Interactive Approach For LLM Reasoning In Physics Problems
- 2026PhysicsMind: Sim and Real Mechanics Benchmarking for Physical Reasoning and Prediction in Foundational VLMs and World Models
- 2025Can Theoretical Physics Research Benefit from Language Agents?