PHYRE: A New Benchmark for Physical Reasoning
Not on the map. Why?
Cited by 23 in LLM reasoning, but placed by its own abstract, which didn’t fit.
Abstract (arXiv)
Understanding and reasoning about physics is an important ability of intelligent agents. We develop the PHYRE benchmark for physical reasoning that contains a set of simple classical mechanics puzzles in a 2D physical environment. The benchmark is designed to encourage the development of learning algorithms that are sample-efficient and generalize well across puzzles. We test several modern learning algorithms on PHYRE and find that these algorithms fall short in solving the puzzles efficiently. We expect that PHYRE will encourage the development of novel sample-efficient agents that learn efficient but useful models of physics. For code and to play PHYRE for yourself, please visit https://player.phyre.ai.
Key facts. Cited by 137 papers in the map (data through 7 Oct 2026). First posted on arXiv 15 Aug 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 20; 2022: 18; 2023: 19; 2024: 14; 2025: 21; 2026: 45.
137 papers.
Sort:
By area:
- 2024How Far is Video Generation from World Model: A Physical Law Perspectivecited by 204
- 2022SlotFormer: Unsupervised Visual Dynamics Simulation with Object-Centric Modelscited by 146
- 2021Physion: Evaluating Physical Prediction from Vision in Humans and Machinescited by 145
- 2025VideoPhy-2: A Challenging Action-Centric Physical Commonsense Evaluation in Video Generationcited by 141
- 2022Mind's Eye: Grounded Language Model Reasoning through Simulationcited by 83
- 2023Generalization on the Unseen, Logic Reasoning and Degree Curriculumcited by 73
- 2021Grounding Physical Concepts of Objects and Events Through Dynamic Visual Reasoningcited by 68
- 2022ComPhy: Compositional Physical Reasoning of Objects and Events from Videoscited by 61
- 2021Dynamic Visual Reasoning by Learning Differentiable Physics Models from Video and Languagecited by 55
- 2021Systematic Evaluation of Causal Discovery in Visual Model Based Reinforcement Learningcited by 53
- 2025IntPhys 2: Benchmarking Intuitive Physics Understanding In Complex Synthetic Environmentscited by 49
- 2021PROST: Physical Reasoning of Objects through Space and Timecited by 48
38 more
- 2023NEWTON: Are Large Language Models Capable of Physical Reasoning?cited by 45
- 2025Evaluating Newtonian Mechanics in Video Generative Models with Real Physical Systemscited by 44
- 2022A Benchmark for Compositional Visual Reasoningcited by 43
- 2021AGENT: A Benchmark for Core Psychological Reasoningcited by 42
- 2023Benchmarks for Automated Commonsense Reasoning: A Surveycited by 40
- 2024Kinetix: Investigating the Training of General Agents through Open-Ended Physics-Based Control Taskscited by 40
- 2023Visual cognition in multimodal large language modelscited by 38
- 2022Physical Design using Differentiable Learned Simulatorscited by 37
- 2024How Far Can Transformers Reason? The Globality Barrier and Inductive Scratchpadcited by 35
- 2025CausalVQA: A Physically Grounded Causal Reasoning Benchmark for Video Modelscited by 35
- 2022Bongard-HOI: Benchmarking Few-Shot Visual Reasoning for Human-Object Interactionscited by 34
- 2022A Review of Emerging Research Directions in Abstract Visual Reasoningcited by 33
- 2023MacGyver: Are Large Language Models Creative Problem Solvers?cited by 33
- 2026Causal-JEPA: Learning World Models through Object-Level Latent Maskingcited by 25
- 2025Do Vision-Language Models Have Internal World Models? Towards an Atomic Evaluationcited by 23
- 2021Capturing the objects of vision with neural networkscited by 21
- 2022A Survey on Machine Learning Approaches for Modelling Intuitive Physicscited by 20
- 2021Tiered Reasoning for Intuitive Physics: Toward Verifiable Commonsense Language Understandingcited by 19
- 2023DDLP: Unsupervised Object-Centric Video Prediction with Deep Dynamic Latent Particlescited by 18
- 2023Bongard-OpenWorld: Few-Shot Reasoning for Free-form Visual Concepts in the Real Worldcited by 18
- 2026Interpreting Physics in Video World Modelscited by 18
- 2025ABench-Physics: Benchmarking Physical Reasoning in LLMs via High-Difficulty and Dynamic Physics Problemscited by 17
- 2025TRAVL: A Recipe for Making Video-Language Models Better Judges of Physics Implausibilitycited by 16
- 2023I-PHYRE: Interactive Physical Reasoningcited by 15
- 2022Towards Understanding How Machines Can Learn Causal Overhypothesescited by 13
- 2023Neural Foundations of Mental Simulation: Future Prediction of Latent Representations on Dynamic Scenescited by 13
- 2026WorldBench: Benchmarking Physical Understanding of World Models by Isolating Physics Conceptscited by 12
- 2022On the Learning Mechanisms in Physical Reasoningcited by 11
- 2023CLEVRER-Humans: Describing Physical and Causal Events the Human Waycited by 11
- 2023Understanding Physical Dynamics with Counterfactual World Modelingcited by 11
- 2024Compositional Physical Reasoning of Objects and Events from Videoscited by 11
- 2026Latent Particle World Models: Self-supervised Object-centric Stochastic Dynamics Modelingcited by 11
- 2021Phy-Q as a measure for physical reasoning intelligencecited by 10
- 2024SPARTAN: A Sparse Transformer World Model Attending to What Matterscited by 10
- 2026PhysicsMind: Sim and Real Mechanics Benchmarking for Physical Reasoning and Prediction in Foundational VLMs and World Modelscited by 10
- 2021Maintaining Common Ground in Dynamic Environmentscited by 9
- 2024Tackling the Abstraction and Reasoning Corpus with Vision Transformers: the Importance of 2D Representation, Positions, and Objectscited by 9
- 2026PhysInOne: Visual Physics Learning and Reasoning in One Suitecited by 9
50 most cited of 137 All 137 (JSON)
- 2026OmniFysics-Nano-V2 Technical Report: Understanding the Physical World Across Modalities22 Sep 2026
- 2026PolyBridgeBench: Benchmarking Multimodal LLMs for Physics-Grounded Bridge Design18 Sep 2026
- 2026CompAdapt: Adaptable Composite Motion Modeling for Physics-Consistent Text-to-Video Generation18 Sep 2026
- 2026PIVOT: Physics-Grounded Verification for AI-Generated Audio-Video Detection14 Sep 2026
- 2026New Evidence, Same Choice: Testing Physical Experiment Selection in Vision Language Models10 Sep 2026
- 2026CALIPER: Clean Scenes Cannot Rank Physical Inference in Pretrained Visual Representations8 Sep 2026
- 2026PhysWeep: Does a Video Generator Realize the Physics You Ask For?5 Sep 2026
- 2026Physical Kernel: Structured Visual Latents for Dark Manipulation4 Sep 2026
- 2026Principia: Relational Physics Tests for Video Models3 Sep 2026
- 2026Code as Worlds: Agentic Discovery of Executable World Representations for Physical Reasoning27 Aug 2026
- 2026TRAPSBench: Vision-Language Models Encode but Fail to Express Epistemic Restraint13 Aug 2026
- 2026NewtonGS: Physics-Structured Object-Level Neural Newtonian Dynamics for Gaussian Scene Animation6 Aug 2026
38 more
- 2026SiPhy: Single-Image Physical Property Reasoning24 Jul 2026
- 2026IMBench: A Benchmark for Intuitive Robotic Manipulation17 Jul 2026
- 2026SportD: How do VLMs physically strategize?16 Jul 2026
- 2026The Seriality Gap in Video Diffusion Models14 Jul 2026
- 2026Bridging Physical Reasoning and Task Generalization via Visual Action Outcome Reasoning Alignment7 Jul 2026
- 2026WorldDirector: Building Controllable World Simulators with Persistent Dynamic Memory2 Jul 2026
- 2026Hierarchical Experimentalist Agents28 Jun 2026
- 2026Event-Conditioned Diagnostics of Kinematic, Contact, and Object-Permanence Structure in Passive Object-State World Models26 Jun 2026
- 2026PhysEditWorld: A Large-Scale Dataset Toward Physics-Editable World Models25 Jun 2026
- 2026GPU-Accelerated Inverse Structural Anastylosis from Block Collapse Dynamics23 Jun 2026
- 2026Physics-IQ Verified17 Jun 2026
- 2026World Models Meet Language Models: On the Complementarity of Concrete and Abstract Reasoning2 Jun 2026
- 2026WorldCoder-Bench: Benchmarking Physically Grounded 3D World Synthesis1 Jun 2026
- 2026MPMWorlds: Material-Point-Method Simulations for Inferring and Extrapolating Physical Dynamics1 Jun 2026
- 2026SVI-Bench: A Dynamic Microworld for Strategic Video Intelligence29 May 2026
- 2026BilliardPhys-Bench: Benchmarking Physical Reasoning and Visual Dynamics of Multimodal LLMs29 May 2026
- 2026What-If World: A Causal Benchmark for General World Models in Embodied Scenarios26 May 2026
- 2026STATERA: Hidden Mass Estimation via Zero-Shot Sim-to-Real Kinematics using Frozen Temporal Tubelets21 May 2026
- 2026Entity-Centric World Models: Interaction-Aware Masking for Causal Video Prediction14 May 2026
- 2026PhysLayer: Language-Guided Layered Animation with Depth-Aware Physics26 Apr 2026
- 2026SketchVLM: Vision language models can annotate images to explain thoughts and guide users23 Apr 2026
- 2026PhysInOne: Visual Physics Learning and Reasoning in One Suite10 Apr 2026
- 2026Overhang Tower: Resource-Rational Adaptation in Sequential Physical Planning10 Apr 2026
- 2026Latent Particle World Models: Self-supervised Object-centric Stochastic Dynamics Modeling4 Mar 2026
- 2026SCP: Spatial Causal Prediction in Video4 Mar 2026
- 2026Causal-JEPA: Learning World Models through Object-Level Latent Masking11 Feb 2026
- 2026Discovering High Level Patterns from Simulation Traces10 Feb 2026
- 2026VisPhyWorld: Probing Physical Reasoning via Code-Driven Video Reconstruction9 Feb 2026
- 2026Interpreting Physics in Video World Models4 Feb 2026
- 2026Learning Physics-Grounded 4D Dynamics with Neural Gaussian Force Fields29 Jan 2026
- 2026WorldBench: Benchmarking Physical Understanding of World Models by Isolating Physics Concepts29 Jan 2026
- 2026PhysicsMind: Sim and Real Mechanics Benchmarking for Physical Reasoning and Prediction in Foundational VLMs and World Models22 Jan 2026
- 2026Image2Garment: Simulation-ready Garment Generation from a Single Image14 Jan 2026
- 2025XDen-1K: A Density Field Dataset of Real-World Objects11 Dec 2025
- 2025SmallWorlds: Assessing Dynamics Understanding of World Models in Isolated Environments28 Nov 2025
- 2025Benchmarking World-Model Learning with Environment-Level Queries22 Oct 2025
- 2025BuildArena: A Physics-Aligned Interactive Benchmark of LLMs for Engineering Construction18 Oct 2025
- 2025TRAVL: A Recipe for Making Video-Language Models Better Judges of Physics Implausibility8 Oct 2025
50 newest of 137 All 137 (JSON)
- 2024How Far is Video Generation from World Model: A Physical Law Perspectivecited by 204
- 2025Evaluating Newtonian Mechanics in Video Generative Models with Real Physical Systemscited by 44
- 2026Causal-JEPA: Learning World Models through Object-Level Latent Maskingcited by 25
- 2025Do Vision-Language Models Have Internal World Models? Towards an Atomic Evaluationcited by 23
- 2026Interpreting Physics in Video World Modelscited by 18
- 2026WorldBench: Benchmarking Physical Understanding of World Models by Isolating Physics Conceptscited by 12
- 2023Understanding Physical Dynamics with Counterfactual World Modelingcited by 11
- 2026Latent Particle World Models: Self-supervised Object-centric Stochastic Dynamics Modelingcited by 11
- 2024SPARTAN: A Sparse Transformer World Model Attending to What Matterscited by 10
- 2026PhysicsMind: Sim and Real Mechanics Benchmarking for Physical Reasoning and Prediction in Foundational VLMs and World Modelscited by 10
- 2025Benchmarking World-Model Learning with Environment-Level Queriescited by 7
- 2022Factored World Models for Zero-Shot Generalization in Robotic Manipulationcited by 6
12 most cited of 23 All 23 (JSON)
- 2026WorldDirector: Building Controllable World Simulators with Persistent Dynamic Memory2 Jul 2026
- 2026Event-Conditioned Diagnostics of Kinematic, Contact, and Object-Permanence Structure in Passive Object-State World Models26 Jun 2026
- 2026PhysEditWorld: A Large-Scale Dataset Toward Physics-Editable World Models25 Jun 2026
- 2026Physics-IQ Verified17 Jun 2026
- 2026World Models Meet Language Models: On the Complementarity of Concrete and Abstract Reasoning2 Jun 2026
- 2026What-If World: A Causal Benchmark for General World Models in Embodied Scenarios26 May 2026
- 2026Entity-Centric World Models: Interaction-Aware Masking for Causal Video Prediction14 May 2026
- 2026Latent Particle World Models: Self-supervised Object-centric Stochastic Dynamics Modeling4 Mar 2026
- 2026Causal-JEPA: Learning World Models through Object-Level Latent Masking11 Feb 2026
- 2026Interpreting Physics in Video World Models4 Feb 2026
- 2026WorldBench: Benchmarking Physical Understanding of World Models by Isolating Physics Concepts29 Jan 2026
- 2026PhysicsMind: Sim and Real Mechanics Benchmarking for Physical Reasoning and Prediction in Foundational VLMs and World Models22 Jan 2026
12 newest of 23 All 23 (JSON)
- 2022Mind's Eye: Grounded Language Model Reasoning through Simulationcited by 83
- 2023NEWTON: Are Large Language Models Capable of Physical Reasoning?cited by 45
- 2022A Benchmark for Compositional Visual Reasoningcited by 43
- 2023Benchmarks for Automated Commonsense Reasoning: A Surveycited by 40
- 2025CausalVQA: A Physically Grounded Causal Reasoning Benchmark for Video Modelscited by 35
- 2022Bongard-HOI: Benchmarking Few-Shot Visual Reasoning for Human-Object Interactionscited by 34
- 2022A Review of Emerging Research Directions in Abstract Visual Reasoningcited by 33
- 2023Bongard-OpenWorld: Few-Shot Reasoning for Free-form Visual Concepts in the Real Worldcited by 18
- 2025ABench-Physics: Benchmarking Physical Reasoning in LLMs via High-Difficulty and Dynamic Physics Problemscited by 17
- 2024Tackling the Abstraction and Reasoning Corpus with Vision Transformers: the Importance of 2D Representation, Positions, and Objectscited by 9
- 2022EvEntS ReaLM: Event Reasoning of Entity States via Language Modelscited by 7
- 2026Code as Worlds: Agentic Discovery of Executable World Representations for Physical Reasoningcited by 6
12 most cited of 21 All 21 (JSON)
- 2026Code as Worlds: Agentic Discovery of Executable World Representations for Physical Reasoning27 Aug 2026
- 2026Bridging Physical Reasoning and Task Generalization via Visual Action Outcome Reasoning Alignment7 Jul 2026
- 2026BilliardPhys-Bench: Benchmarking Physical Reasoning and Visual Dynamics of Multimodal LLMs29 May 2026
- 2026SketchVLM: Vision language models can annotate images to explain thoughts and guide users23 Apr 2026
- 2026SCP: Spatial Causal Prediction in Video4 Mar 2026
- 2026VisPhyWorld: Probing Physical Reasoning via Code-Driven Video Reconstruction9 Feb 2026
- 2025ABench-Physics: Benchmarking Physical Reasoning in LLMs via High-Difficulty and Dynamic Physics Problems7 Jul 2025
- 2025CausalVQA: A Physically Grounded Causal Reasoning Benchmark for Video Models11 Jun 2025
- 2025SPhyR: Spatial-Physical Reasoning Benchmark on Material Distribution21 May 2025
- 2025APEX: Empowering LLMs with Physics-Based Task Planning for Real-time Insight20 May 2025
- 2024Tackling the Abstraction and Reasoning Corpus with Vision Transformers: the Importance of 2D Representation, Positions, and Objects8 Oct 2024
- 2023Bongard-OpenWorld: Few-Shot Reasoning for Free-form Visual Concepts in the Real World16 Oct 2023
12 newest of 21 All 21 (JSON)
- 2023Visual cognition in multimodal large language modelscited by 38
- 2026TRAPSBench: Vision-Language Models Encode but Fail to Express Epistemic Restraintcited by 3
- 2025InPhyRe Discovers: Large Multimodal Models Struggle in Inductive Physical Reasoningcited by 2
- 2026New Evidence, Same Choice: Testing Physical Experiment Selection in Vision Language Modelscited by 0
- 2026PolyBridgeBench: Benchmarking Multimodal LLMs for Physics-Grounded Bridge Designcited by 0
- 2026PolyBridgeBench: Benchmarking Multimodal LLMs for Physics-Grounded Bridge Design18 Sep 2026
- 2026New Evidence, Same Choice: Testing Physical Experiment Selection in Vision Language Models10 Sep 2026
- 2026TRAPSBench: Vision-Language Models Encode but Fail to Express Epistemic Restraint13 Aug 2026
- 2025InPhyRe Discovers: Large Multimodal Models Struggle in Inductive Physical Reasoning12 Sep 2025
- 2023Visual cognition in multimodal large language models27 Nov 2023
- 2024BenchAgents: Multi-Agent Systems for Structured Benchmark Creationcited by 6
- 2026Hierarchical Experimentalist Agentscited by 2
- 2026SVI-Bench: A Dynamic Microworld for Strategic Video Intelligencecited by 0
- 2026Hierarchical Experimentalist Agents28 Jun 2026
- 2026SVI-Bench: A Dynamic Microworld for Strategic Video Intelligence29 May 2026
- 2024BenchAgents: Multi-Agent Systems for Structured Benchmark Creation29 Oct 2024
- 2026IMBench: A Benchmark for Intuitive Robotic Manipulationcited by 1
- 2026IMBench: A Benchmark for Intuitive Robotic Manipulation17 Jul 2026
- 2022SlotFormer: Unsupervised Visual Dynamics Simulation with Object-Centric Modelscited by 146
- 2021Physion: Evaluating Physical Prediction from Vision in Humans and Machinescited by 145
- 2025VideoPhy-2: A Challenging Action-Centric Physical Commonsense Evaluation in Video Generationcited by 141
- 2023Generalization on the Unseen, Logic Reasoning and Degree Curriculumcited by 73
- 2021Grounding Physical Concepts of Objects and Events Through Dynamic Visual Reasoningcited by 68
- 2022ComPhy: Compositional Physical Reasoning of Objects and Events from Videoscited by 61
- 2021Dynamic Visual Reasoning by Learning Differentiable Physics Models from Video and Languagecited by 55
- 2021Systematic Evaluation of Causal Discovery in Visual Model Based Reinforcement Learningcited by 53
- 2025IntPhys 2: Benchmarking Intuitive Physics Understanding In Complex Synthetic Environmentscited by 49
- 2021PROST: Physical Reasoning of Objects through Space and Timecited by 48
- 2021AGENT: A Benchmark for Core Psychological Reasoningcited by 42
- 2024Kinetix: Investigating the Training of General Agents through Open-Ended Physics-Based Control Taskscited by 40
12 most cited of 80 All 80 (JSON)
- 2026OmniFysics-Nano-V2 Technical Report: Understanding the Physical World Across Modalities22 Sep 2026
- 2026PIVOT: Physics-Grounded Verification for AI-Generated Audio-Video Detection14 Sep 2026
- 2026CALIPER: Clean Scenes Cannot Rank Physical Inference in Pretrained Visual Representations8 Sep 2026
- 2026PhysWeep: Does a Video Generator Realize the Physics You Ask For?5 Sep 2026
- 2026Physical Kernel: Structured Visual Latents for Dark Manipulation4 Sep 2026
- 2026Principia: Relational Physics Tests for Video Models3 Sep 2026
- 2026NewtonGS: Physics-Structured Object-Level Neural Newtonian Dynamics for Gaussian Scene Animation6 Aug 2026
- 2026SiPhy: Single-Image Physical Property Reasoning24 Jul 2026
- 2026SportD: How do VLMs physically strategize?16 Jul 2026
- 2026GPU-Accelerated Inverse Structural Anastylosis from Block Collapse Dynamics23 Jun 2026
- 2026WorldCoder-Bench: Benchmarking Physically Grounded 3D World Synthesis1 Jun 2026
- 2026STATERA: Hidden Mass Estimation via Zero-Shot Sim-to-Real Kinematics using Frozen Temporal Tubelets21 May 2026
12 newest of 80 All 80 (JSON)