IRIS: A Real-World Benchmark for Inverse Recovery and Identification of Physical Dynamic Systems from Monocular Video
Not on the map. Why?
Abstract (arXiv)
Unsupervised physical parameter estimation from video lacks a common benchmark: existing methods evaluate on non-overlapping synthetic data, the sole real-world dataset is restricted to single-body systems, and no established protocol addresses governing-equation identification. This work introduces IRIS, a high-fidelity benchmark comprising 240 real-world videos captured at 4K resolution and 60fps, spanning both single- and multi-body dynamics with independently measured ground-truth parameters and uncertainty estimates. Each dynamical system is recorded under controlled laboratory conditions and paired with its governing equations, enabling principled evaluation. A standardized evaluation protocol is defined encompassing parameter accuracy, identifiability, extrapolation, robustness, and governing-equation selection. Multiple baselines are evaluated, including a multi-step physics loss formulation and four complementary equation-identification strategies (VLM temporal reasoning, describe-then-classify prompting, CNN-based classification, and path-based labelling), establishing reference performance across all IRIS scenarios and exposing systematic failure modes that motivate future research. The dataset, annotations, evaluation toolkit, and all baseline implementations are publicly released.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 28 of its 44 references that are in the map. First posted on arXiv 17 Mar 2026.
Builds on
28 of 44 references.
References · 28
- 2023Visual Instruction Tuningcited by 7,869
- 2018Neural Ordinary Differential Equationscited by 3,779
- 2024SAM 2: Segment Anything in Images and Videoscited by 2,863
- 2020Learning to Simulate Complex Physics with Graph Networkscited by 880
- 2019Hamiltonian Neural Networkscited by 712
- 2024LLaVA-Video: Video Instruction Tuning With Synthetic Datacited by 583
- 2021Learning the solution operator of parametric partial differential equations with physics-informed DeepOnetscited by 540
- 2016Interaction Networks for Learning about Objects, Relations and Physicscited by 509
- 2020Lagrangian Neural Networkscited by 398
- 2020How to train your neural ODE: the world of Jacobian and kinetic regularizationcited by 228
- 2024VideoPhy: Evaluating Physical Commonsense for Video Generationcited by 228
- 2025Do generative video models understand physical principles?cited by 161
16 more
- 2019Hamiltonian Generative Networkscited by 137
- 2016A Differentiable Physics Engine for Deep Learning in Roboticscited by 108
- 2017Visual Interaction Networkscited by 95
- 2021Fast and Feature-Complete Differentiable Physics for Articulated Rigid Bodies with Contactcited by 52
- 2019Physics-as-Inverse-Graphics: Unsupervised Physical Parameter Estimation from Videocited by 45
- 2025R-Bench: Graduate-level Multi-disciplinary Benchmarks for LLM & MLLM Complex Reasoning Evaluationcited by 34
- 2025WorldLens: Full-Spectrum Evaluations of Driving World Models in Real Worldcited by 23
- 2024DiffSim: Taming Diffusion Models for Evaluating Visual Similaritycited by 20
- 2022Neural Implicit Representations for Physical Parameter Inference from a Single Videocited by 19
- 2018Unsupervised Learning of Latent Physical Properties Using Perception-Prediction Networkscited by 13
- 2021Reasoning-Modulated Representationscited by 13
- 2024Learning Physics From Video: Unsupervised Physical Parameter Estimation for Continuous Dynamical Systemscited by 13
- 2024Physics Context Builders: A Modular Framework for Physical Reasoning in Vision-Language Modelscited by 10
- 2025Mimicking the Physicist's Eye:A VLM-centric Approach for Physics Formula Discoverycited by 7
- 2026ContactGaussian-WM: Learning Physics-Grounded World Model from Videoscited by 7
- 2025MLLM-based Discovery of Intrinsic Coordinates and Governing Equations from High-Dimensional Datacited by 2
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026GAUGE: A Measurement-Grounded Benchmark for Physical Fidelity in Simulation Engines and Video World Modelscited by 5
- 2026One Perturbation Is Not Enough: Identifiability and Blind Baselines for Behavioral AI Evaluationcited by 0
- 2026Physics as the label for measuring and correcting materials reasoning in multimodal modelscited by 0
- 2026PhysCodeGym: Benchmarking Coding Agents for Physically Verifiable 4D Reconstructioncited by 0
- 2026PhysCodeGym: Benchmarking Coding Agents for Physically Verifiable 4D Reconstruction12 Oct 2026
- 2026Physics as the label for measuring and correcting materials reasoning in multimodal models10 Sep 2026
- 2026One Perturbation Is Not Enough: Identifiability and Blind Baselines for Behavioral AI Evaluation5 Sep 2026
- 2026GAUGE: A Measurement-Grounded Benchmark for Physical Fidelity in Simulation Engines and Video World Models6 Aug 2026
Similar, not cited
Close in wording, no citation either way
- 2026Physics from Video: Identifiability of Time-Invariant Second-Order ODEs under Minimal Trajectory Conditions
- 2026World Models' Last Exam in Physics
- 2026KineBench: Benchmarking Embodied World Models via IDM-Free Kinematic Grounding
- 2026Learning Explicit Physical Parameter Control and Benchmarking for Video Generation
- 2026PhySimCode: A Benchmark and Evaluation Method for Physics Video to Code Generation
- 2025Evaluating Newtonian Mechanics in Video Generative Models with Real Physical Systems
- 2026PhyGround: Benchmarking Physical Reasoning in Generative World Models
- 2026PhysicsLENS: Diagnosing Physical Property Blindness in Video Generation Models