mlsanityData to 14 Oct 2026

The Pulse of Motion: Measuring Physical Frame Rate from Visual Dynamics

arXiv 2603.14375 ↗First posted 15 Mar 2026cs.CV cs.AIcited by 8

On the map: World models → Latent predictive world models

Abstract (arXiv)

While recent generative video models have achieved remarkable visual realism and are being explored as world models, true physical simulation requires mastering both space and time. Current models can produce visually smooth kinematics, yet they lack a reliable internal motion pulse to ground these motions in a consistent, real-world time scale. This temporal ambiguity stems from the common practice of indiscriminately training on videos with vastly different real-world speeds, forcing them into standardized frame rates. This leads to what we term chronometric hallucination: generated sequences exhibit ambiguous, unstable, and uncontrollable physical motion speeds. To address this, we propose Visual Chronometer, a predictor that recovers the Physical Frames Per Second (PhyFPS) directly from the visual dynamics of an input video. Trained via controlled temporal resampling, our method estimates the true temporal scale implied by the motion itself, bypassing unreliable metadata. To systematically quantify this issue, we establish two benchmarks, PhyFPS-Bench-Real and PhyFPS-Bench-Gen. Our evaluations reveal a harsh reality: state-of-the-art video generators suffer from severe PhyFPS misalignment and temporal instability. Finally, we demonstrate that applying PhyFPS corrections significantly improves the human-perceived naturalness of AI-generated videos. Our project page is https://xiangbogaobarry.github.io/Visual_Chronometer/.

Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Placed in Latent predictive world models, one of 11 directions in World models. Builds on 39 of its 58 references that are in the map. First posted on arXiv 15 Mar 2026.

Builds on

39 of 58 references.

Closest ancestors · 1

Same direction, newest first

  1. 2024How Far is Video Generation from World Model: A Physical Law Perspective4 Nov

Other references · 38

  1. 2017Attention Is All You Needcited by 60,361
  2. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
  3. 2025Qwen3 Technical Reportcited by 8,820
  4. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
  5. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
  6. 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,822
  7. 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,660
  8. 2022VideoMAE: Masked Autoencoders are Data-Efficient Learners for Self-Supervised Video Pre-Trainingcited by 1,322
  9. 2022CogVideo: Large-scale Pretraining for Text-to-Video Generation via Transformerscited by 985
  10. 2024WorldSimBench: Towards Video Generation Models as World Simulatorscited by 881
  11. 2024LTX-Video: Realtime Video Latent Diffusioncited by 581
  12. 2016Monocular 3D Human Pose Estimation In The Wild Using Improved CNN Supervisioncited by 494
26 more
  1. 2025VACE: All-in-One Video Creation and Editingcited by 479
  2. 2025VBench-2.0: Advancing Video Generation Benchmark Suite for Intrinsic Faithfulnesscited by 315
  3. 2021StyleGAN-V: A Continuous Video Generator with the Price, Image Quality and Perks of StyleGAN2cited by 301
  4. 2026LTX-2: Efficient Joint Audio-Visual Foundation Modelcited by 236
  5. 2020Real-Time Intermediate Flow Estimation for Video Frame Interpolationcited by 213
  6. 2025World Simulation with Video Foundation Models for Physical AIcited by 200
  7. 2020SpeedNet: Learning the Speediness in Videoscited by 171
  8. 2024Understanding World or Predicting Future? A Comprehensive Survey of World Modelscited by 166
  9. 2025WorldScore: A Unified Evaluation Benchmark for World Generationcited by 156
  10. 2026Advancing Open-source World Modelscited by 154
  11. 2018Toward Driving Scene Understanding: A Dataset for Learning Driver Behavior and Causal Reasoningcited by 102
  12. 2021RAPIQUE: Rapid and Accurate Video Quality Prediction of User Generated Contentcited by 100
  13. 2025InfinityStar: Unified Spacetime AutoRegressive Modeling for Visual Generationcited by 45
  14. 2025NewtonGen: Physics-Consistent and Controllable Text-to-Video Generation via Neural Newtonian Dynamicscited by 41
  15. 2025DenseDPO: Fine-Grained Temporal Preference Optimization for Video Diffusion Modelscited by 34
  16. 2024Large Motion Video Autoencoding with Cross-modal Video VAEcited by 19
  17. 2025MotionV2V: Editing Motion in a Videocited by 14
  18. 2018FFNet: Video Fast-Forwarding via Reinforcement Learningcited by 13
  19. 2018A Weighted Sparse Sampling and Smoothing Frame Transition Approach for Semantic Fast-Forward First-Person Videoscited by 11
  20. 2022FAVER: Blind Quality Prediction of Variable Frame Rate Videoscited by 10
  21. 2026PISCO: Precise Video Instance Insertion with Sparse Controlcited by 10
  22. 2026ConsID-Gen: View-Consistent and Identity-Preserving Image-to-Video Generationcited by 8
  23. 2022BVI-VFI: A Video Quality Database for Video Frame Interpolationcited by 7
  24. 2025Seeing the Wind from a Falling Leafcited by 7
  25. 2026InfinityStory: Unlimited Video Generation with World Consistency and Character-Aware Shot Transitionscited by 7
  26. 2026A Mechanistic View on Video Generation as World Models: State and Dynamicscited by 6

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 8.

8 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Temporal Realism Evaluation of Generated Videos Using Compressed-Domain Motion Vectors
  2. 2026PhySimCode: A Benchmark and Evaluation Method for Physics Video to Code Generation
  3. 2025Physics-Guided Motion Loss for Video Generation Model
  4. 2026LaMo: Self-Supervised Latent Motion Priors for Physical Realism in Video Generation
  5. 2026PhyCo: Learning Controllable Physical Priors for Generative Motion
  6. 2026CRONOS: Benchmarking Counterfactual Physical Consistency in Video Models
  7. 2025"PhyWorldBench": A Comprehensive Evaluation of Physical Realism in Text-to-Video Models
  8. 2025PhysCtrl: Generative Physics for Controllable and Physics-Grounded Video Generation