The Pulse of Motion: Measuring Physical Frame Rate from Visual Dynamics
On the map: World models → Latent predictive world models
Abstract (arXiv)
While recent generative video models have achieved remarkable visual realism and are being explored as world models, true physical simulation requires mastering both space and time. Current models can produce visually smooth kinematics, yet they lack a reliable internal motion pulse to ground these motions in a consistent, real-world time scale. This temporal ambiguity stems from the common practice of indiscriminately training on videos with vastly different real-world speeds, forcing them into standardized frame rates. This leads to what we term chronometric hallucination: generated sequences exhibit ambiguous, unstable, and uncontrollable physical motion speeds. To address this, we propose Visual Chronometer, a predictor that recovers the Physical Frames Per Second (PhyFPS) directly from the visual dynamics of an input video. Trained via controlled temporal resampling, our method estimates the true temporal scale implied by the motion itself, bypassing unreliable metadata. To systematically quantify this issue, we establish two benchmarks, PhyFPS-Bench-Real and PhyFPS-Bench-Gen. Our evaluations reveal a harsh reality: state-of-the-art video generators suffer from severe PhyFPS misalignment and temporal instability. Finally, we demonstrate that applying PhyFPS corrections significantly improves the human-perceived naturalness of AI-generated videos. Our project page is https://xiangbogaobarry.github.io/Visual_Chronometer/.
Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Placed in Latent predictive world models, one of 11 directions in World models. Builds on 39 of its 58 references that are in the map. First posted on arXiv 15 Mar 2026.
Builds on
39 of 58 references.
Closest ancestors · 1
Same direction, newest first
Other references · 38
- 2017Attention Is All You Needcited by 60,361
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 2025Qwen3 Technical Reportcited by 8,820
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
- 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,822
- 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,660
- 2022VideoMAE: Masked Autoencoders are Data-Efficient Learners for Self-Supervised Video Pre-Trainingcited by 1,322
- 2022CogVideo: Large-scale Pretraining for Text-to-Video Generation via Transformerscited by 985
- 2024WorldSimBench: Towards Video Generation Models as World Simulatorscited by 881
- 2024LTX-Video: Realtime Video Latent Diffusioncited by 581
- 2016Monocular 3D Human Pose Estimation In The Wild Using Improved CNN Supervisioncited by 494
26 more
- 2025VACE: All-in-One Video Creation and Editingcited by 479
- 2025VBench-2.0: Advancing Video Generation Benchmark Suite for Intrinsic Faithfulnesscited by 315
- 2021StyleGAN-V: A Continuous Video Generator with the Price, Image Quality and Perks of StyleGAN2cited by 301
- 2026LTX-2: Efficient Joint Audio-Visual Foundation Modelcited by 236
- 2020Real-Time Intermediate Flow Estimation for Video Frame Interpolationcited by 213
- 2025World Simulation with Video Foundation Models for Physical AIcited by 200
- 2020SpeedNet: Learning the Speediness in Videoscited by 171
- 2024Understanding World or Predicting Future? A Comprehensive Survey of World Modelscited by 166
- 2025WorldScore: A Unified Evaluation Benchmark for World Generationcited by 156
- 2026Advancing Open-source World Modelscited by 154
- 2018Toward Driving Scene Understanding: A Dataset for Learning Driver Behavior and Causal Reasoningcited by 102
- 2021RAPIQUE: Rapid and Accurate Video Quality Prediction of User Generated Contentcited by 100
- 2025InfinityStar: Unified Spacetime AutoRegressive Modeling for Visual Generationcited by 45
- 2025NewtonGen: Physics-Consistent and Controllable Text-to-Video Generation via Neural Newtonian Dynamicscited by 41
- 2025DenseDPO: Fine-Grained Temporal Preference Optimization for Video Diffusion Modelscited by 34
- 2024Large Motion Video Autoencoding with Cross-modal Video VAEcited by 19
- 2025MotionV2V: Editing Motion in a Videocited by 14
- 2018FFNet: Video Fast-Forwarding via Reinforcement Learningcited by 13
- 2018A Weighted Sparse Sampling and Smoothing Frame Transition Approach for Semantic Fast-Forward First-Person Videoscited by 11
- 2022FAVER: Blind Quality Prediction of Variable Frame Rate Videoscited by 10
- 2026PISCO: Precise Video Instance Insertion with Sparse Controlcited by 10
- 2026ConsID-Gen: View-Consistent and Identity-Preserving Image-to-Video Generationcited by 8
- 2022BVI-VFI: A Video Quality Database for Video Frame Interpolationcited by 7
- 2025Seeing the Wind from a Falling Leafcited by 7
- 2026InfinityStory: Unlimited Video Generation with World Consistency and Character-Aware Shot Transitionscited by 7
- 2026A Mechanistic View on Video Generation as World Models: State and Dynamicscited by 6
Built on by
Citing papers per year: 2026: 8.
8 papers.
- 2026VGGRPO: Towards World-Consistent Video Generation with 4D Latent Rewardcited by 24
- 2026Scaling Mixture-of-Experts Video Pretraining for Embodied Intelligencecited by 15
- 2026SparkVSR: Interactive Video Super-Resolution via Sparse Keyframe Propagationcited by 5
- 2026VEFX-Bench: A Holistic Benchmark for Generic Video Editing and Visual Effectscited by 4
- 2026Physics-Aware Video Instance Removal Benchmarkcited by 3
- 2026Seeing Fast and Slow: Learning the Flow of Time in Videoscited by 1
- 2026ViTeX-Bench: Benchmarking High-Fidelity Video Scene Text Editingcited by 0
- 2026How Does Geometry Enter Generated Motion?cited by 0
- 2026How Does Geometry Enter Generated Motion?4 Oct 2026
- 2026ViTeX-Bench: Benchmarking High-Fidelity Video Scene Text Editing30 Sep 2026
- 2026Scaling Mixture-of-Experts Video Pretraining for Embodied Intelligence8 Jul 2026
- 2026Seeing Fast and Slow: Learning the Flow of Time in Videos23 Apr 2026
- 2026VEFX-Bench: A Holistic Benchmark for Generic Video Editing and Visual Effects17 Apr 2026
- 2026Physics-Aware Video Instance Removal Benchmark7 Apr 2026
- 2026VGGRPO: Towards World-Consistent Video Generation with 4D Latent Reward27 Mar 2026
- 2026SparkVSR: Interactive Video Super-Resolution via Sparse Keyframe Propagation17 Mar 2026
Similar, not cited
Close in wording, no citation either way
- 2025Temporal Realism Evaluation of Generated Videos Using Compressed-Domain Motion Vectors
- 2026PhySimCode: A Benchmark and Evaluation Method for Physics Video to Code Generation
- 2025Physics-Guided Motion Loss for Video Generation Model
- 2026LaMo: Self-Supervised Latent Motion Priors for Physical Realism in Video Generation
- 2026PhyCo: Learning Controllable Physical Priors for Generative Motion
- 2026CRONOS: Benchmarking Counterfactual Physical Consistency in Video Models
- 2025"PhyWorldBench": A Comprehensive Evaluation of Physical Realism in Text-to-Video Models
- 2025PhysCtrl: Generative Physics for Controllable and Physics-Grounded Video Generation