MoVieS: Motion-Aware 4D Dynamic View Synthesis in One Second
Not on the map. Why?
Abstract (arXiv)
We present MoVieS, a Motion-aware View Synthesis model that reconstructs 4D dynamic scenes from monocular videos in one second. It represents dynamic 3D scenes with pixel-aligned Gaussian primitives and explicitly supervises their time-varying motions. This allows, for the first time, the unified modeling of appearance, geometry and motion from monocular videos, and enables reconstruction, view synthesis and 3D point tracking within a single learning-based framework. By bridging view synthesis with geometry reconstruction, MoVieS enables large-scale training on diverse datasets with minimal dependence on task-specific supervision. As a result, it also naturally supports a wide range of zero-shot applications, such as scene flow estimation and moving object segmentation. Extensive experiments validate the effectiveness and efficiency of MoVieS across multiple tasks, achieving competitive performance while offering several orders of magnitude speedups.
Key facts. Cited by 31 papers in the map (data through 7 Oct 2026). Builds on 94 of its 105 references that are in the map. First posted on arXiv 14 Jul 2025.
Builds on
94 of 105 references.
References · 94
- 2017Attention Is All You Needcited by 59,932
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
- 2016SGDR: Stochastic Gradient Descent with Warm Restartscited by 4,993
- 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,385
- 2021Vision Transformers for Dense Predictioncited by 1,789
- 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,526
- 2019Towards Robust Monocular Depth Estimation: Mixing Datasets for Zero-shot Cross-dataset Transfercited by 1,484
- 2025VGGT: Visual Geometry Grounded Transformercited by 1,475
- 2020D-NeRF: Neural Radiance Fields for Dynamic Scenescited by 1,459
- 2024Depth Anything V2cited by 1,385
38 more
- 2020Nerfies: Deformable Neural Radiance Fieldscited by 1,194
- 20234D Gaussian Splatting for Real-Time Dynamic Scene Renderingcited by 1,144
- 2015ORB-SLAM: a Versatile and Accurate Monocular SLAM Systemcited by 983
- 2024Grounding Image Matching in 3D with MASt3Rcited by 960
- 2016Training Deep Nets with Sublinear Memory Costcited by 825
- 2023Deformable 3D Gaussians for High-Fidelity Monocular Dynamic Scene Reconstructioncited by 753
- 2023K-Planes: Explicit Radiance Fields in Space, Time, and Appearancecited by 742
- 2023Dynamic 3D Gaussians: Tracking by Persistent Dynamic View Synthesiscited by 731
- 2021DROID-SLAM: Deep Visual SLAM for Monocular, Stereo, and RGB-D Camerascited by 673
- 2023pixelSplat: 3D Gaussian Splats from Image Pairs for Scalable Generalizable 3D Reconstructioncited by 668
- 2023HexPlane: A Fast Representation for Dynamic Scenescited by 582
- 2024MVSplat: Efficient 3D Gaussian Splatting from Sparse Multi-View Imagescited by 553
- 2025Continuous 3D Perception Model with Persistent Statecited by 527
- 2023CoTracker: It is Better to Track Togethercited by 516
- 2020TartanAir: A Dataset to Push the Limits of Visual SLAMcited by 494
- 2023Real-time Photorealistic Dynamic Scene Representation and Rendering with 4D Gaussian Splattingcited by 470
- 2024MonST3R: A Simple Approach for Estimating Geometry in the Presence of Motioncited by 431
- 2021Dynamic View Synthesis from Dynamic Monocular Videocited by 420
- 2024Depth Pro: Sharp Monocular Metric Depth in Less Than a Secondcited by 395
- 2024Metric3Dv2: A Versatile Monocular Geometric Foundation Model for Zero-shot Metric Depth and Surface Normal Estimationcited by 389
- 2024UniDepth: Universal Monocular Metric Depth Estimationcited by 375
- 2023Splatter Image: Ultra-Fast Single-View 3D Reconstructioncited by 359
- 2025Fast3R: Towards 3D Reconstruction of 1000+ Images in One Forward Passcited by 356
- 2020Virtual KITTI 2cited by 345
- 2024GS-LRM: Large Reconstruction Model for 3D Gaussian Splattingcited by 344
- 2023Spacetime Gaussian Feature Splatting for Real-Time Dynamic View Synthesiscited by 341
- 2021Light Field Networks: Neural Scene Representations with Single-Evaluation Renderingcited by 330
- 2023Repurposing Diffusion-Based Image Generators for Monocular Depth Estimationcited by 323
- 2024MoGe: Unlocking Accurate Monocular Geometry Estimation for Open-Domain Images with Optimal Training Supervisioncited by 290
- 2023TAPIR: Tracking Any Point with per-frame Initialization and temporal Refinementcited by 281
- 2024gsplat: An Open-Source Library for Gaussian Splattingcited by 279
- 2024DepthSplat: Connecting Gaussian Splatting and Depthcited by 275
- 2023PointOdyssey: A Large-Scale Synthetic Dataset for Long-Term Point Trackingcited by 274
- 2022Unifying Flow, Stereo and Depth Estimationcited by 270
- 20243D Reconstruction with Spatial Memorycited by 269
- 2024Shape of Motion: 4D Reconstruction from a Single Videocited by 247
- 2024No Pose, No Problem: Surprisingly Simple 3D Gaussian Splats from Sparse Unposed Imagescited by 241
- 2023Visual Geometry Grounded Deep Structure From Motioncited by 225
50 most cited of 94 All 94 (JSON)
Built on by
Citing papers per year: 2025: 10; 2026: 21.
31 papers.
Sort:
By area:
- 2026NeoVerse: Enhancing 4D World Model with in-the-wild Monocular Videoscited by 39
- 2025Lyra: Generative 3D Scene Reconstruction via Video Diffusion Model Self-Distillationcited by 37
- 2025Any4D: Unified Feed-Forward Metric 4D Reconstructioncited by 32
- 2025AMB3R: Accurate Feed-forward Metric-scale 3D Reconstruction with Backendcited by 16
- 2026pySpatial: Generating 3D Visual Programs for Zero-Shot Spatial Reasoningcited by 12
- 2026TokenGS: Decoupling 3D Gaussian Prediction from Pixels with Learnable Tokenscited by 11
- 2025Forge4D: Feed-Forward 4D Human Reconstruction and Interpolation from Uncalibrated Sparse-view Videoscited by 7
- 2025PAGE-4D: Disentangled pose and geometry estimation for vggt-4d perceptioncited by 7
- 2025Emergent Extreme-View Geometry in 3D Foundation Modelscited by 5
- 2026MegaFlow: Zero-Shot Large Displacement Optical Flowcited by 5
- 2025Advances in 4D Representation: Geometry, Motion, and Interactioncited by 4
- 2026UFO-4D: Unposed Feedforward 4D Reconstruction from Two Imagescited by 4
19 more
- 2026SLARM: Streaming and Language-Aligned Reconstruction Model for Dynamic Scenescited by 3
- 2026Fast Spatial Memory with Elastic Test-Time Trainingcited by 3
- 2025HuPrior3R: Incorporating Human Priors for Better 3D Dynamic Reconstruction from Monocular Videoscited by 2
- 2026No Pose, No Problem in 4D: Feed-Forward Dynamic Gaussians from Unposed Multi-View Videoscited by 2
- 2026Learning Global Motion with Compact Gaussians for Feed-Forward 4D Reconstructioncited by 2
- 2025Geometry-Aware Single-Image 4D Synthesis via Dense Trajectory Generationcited by 1
- 2026Face Anything: 4D Face Reconstruction from Any Image Sequencecited by 1
- 2026Envision4D: Envisioning Visual Futures via Feed-forward 4D Gaussian Splatting for Autonomous Drivingcited by 1
- 2026UniQuery4R: Unified 4D Scene Reconstruction from a Single Querycited by 1
- 2026VideoTok4D: A 4D-Aware Video Tokenizer for Compact World Representationcited by 1
- 2025Instant Expressive Gaussian Head Avatars at Over 100 FPScited by 0
- 2026Beyond Inpainting: Unleash 3D Understanding for Precise Camera-Controlled Video Generationcited by 0
- 2026RiGS: Rigid-aware 4D Gaussian Splatting from a Single Monocular Videocited by 0
- 20264D Reconstruction from Sparse Dynamic Camerascited by 0
- 2026World from Motion: Generative Dynamic Gaussian Reconstruction from Monocular Videocited by 0
- 2026Unified Panoramic-Gaussian Representation for Monocular 4D Scene Synthesiscited by 0
- 2026Stream4D: 4D-Consistency for Streaming Autoregressive Diffusion Video Modelscited by 0
- 2026Eulerian Motion Reconstruction for Water Scenerycited by 0
- 2026A Compact Explicit 4D Representation for Dynamic Scenescited by 0
- 2026A Compact Explicit 4D Representation for Dynamic Scenes1 Oct 2026
- 2026Eulerian Motion Reconstruction for Water Scenery29 Sep 2026
- 2026VideoTok4D: A 4D-Aware Video Tokenizer for Compact World Representation11 Sep 2026
- 2026Stream4D: 4D-Consistency for Streaming Autoregressive Diffusion Video Models20 Aug 2026
- 2026UniQuery4R: Unified 4D Scene Reconstruction from a Single Query18 Aug 2026
- 2026Unified Panoramic-Gaussian Representation for Monocular 4D Scene Synthesis2 Jul 2026
- 2026World from Motion: Generative Dynamic Gaussian Reconstruction from Monocular Video1 Jul 2026
- 2026Envision4D: Envisioning Visual Futures via Feed-forward 4D Gaussian Splatting for Autonomous Driving9 Jun 2026
- 20264D Reconstruction from Sparse Dynamic Cameras3 Jun 2026
- 2026Learning Global Motion with Compact Gaussians for Feed-Forward 4D Reconstruction29 May 2026
- 2026RiGS: Rigid-aware 4D Gaussian Splatting from a Single Monocular Video22 May 2026
- 2026No Pose, No Problem in 4D: Feed-Forward Dynamic Gaussians from Unposed Multi-View Videos21 May 2026
19 more
- 2026Face Anything: 4D Face Reconstruction from Any Image Sequence21 Apr 2026
- 2026TokenGS: Decoupling 3D Gaussian Prediction from Pixels with Learnable Tokens16 Apr 2026
- 2026Fast Spatial Memory with Elastic Test-Time Training8 Apr 2026
- 2026MegaFlow: Zero-Shot Large Displacement Optical Flow26 Mar 2026
- 2026SLARM: Streaming and Language-Aligned Reconstruction Model for Dynamic Scenes24 Mar 2026
- 2026pySpatial: Generating 3D Visual Programs for Zero-Shot Spatial Reasoning1 Mar 2026
- 2026UFO-4D: Unposed Feedforward 4D Reconstruction from Two Images27 Feb 2026
- 2026Beyond Inpainting: Unleash 3D Understanding for Precise Camera-Controlled Video Generation15 Jan 2026
- 2026NeoVerse: Enhancing 4D World Model with in-the-wild Monocular Videos1 Jan 2026
- 2025Instant Expressive Gaussian Head Avatars at Over 100 FPS18 Dec 2025
- 2025Any4D: Unified Feed-Forward Metric 4D Reconstruction11 Dec 2025
- 2025HuPrior3R: Incorporating Human Priors for Better 3D Dynamic Reconstruction from Monocular Videos6 Dec 2025
- 2025Geometry-Aware Single-Image 4D Synthesis via Dense Trajectory Generation4 Dec 2025
- 2025Emergent Extreme-View Geometry in 3D Foundation Models27 Nov 2025
- 2025AMB3R: Accurate Feed-forward Metric-scale 3D Reconstruction with Backend25 Nov 2025
- 2025Advances in 4D Representation: Geometry, Motion, and Interaction22 Oct 2025
- 2025PAGE-4D: Disentangled pose and geometry estimation for vggt-4d perception20 Oct 2025
- 2025Forge4D: Feed-Forward 4D Human Reconstruction and Interpolation from Uncalibrated Sparse-view Videos29 Sep 2025
- 2025Lyra: Generative 3D Scene Reconstruction via Video Diffusion Model Self-Distillation23 Sep 2025
- 2025Lyra: Generative 3D Scene Reconstruction via Video Diffusion Model Self-Distillationcited by 37
- 2025Instant Expressive Gaussian Head Avatars at Over 100 FPScited by 0
- 2026Beyond Inpainting: Unleash 3D Understanding for Precise Camera-Controlled Video Generationcited by 0
- 2026Stream4D: 4D-Consistency for Streaming Autoregressive Diffusion Video Modelscited by 0
- 2026Stream4D: 4D-Consistency for Streaming Autoregressive Diffusion Video Models20 Aug 2026
- 2026Beyond Inpainting: Unleash 3D Understanding for Precise Camera-Controlled Video Generation15 Jan 2026
- 2025Instant Expressive Gaussian Head Avatars at Over 100 FPS18 Dec 2025
- 2025Lyra: Generative 3D Scene Reconstruction via Video Diffusion Model Self-Distillation23 Sep 2025
- 2025Any4D: Unified Feed-Forward Metric 4D Reconstructioncited by 32
- 2025AMB3R: Accurate Feed-forward Metric-scale 3D Reconstruction with Backendcited by 16
- 2026TokenGS: Decoupling 3D Gaussian Prediction from Pixels with Learnable Tokenscited by 11
- 2025Forge4D: Feed-Forward 4D Human Reconstruction and Interpolation from Uncalibrated Sparse-view Videoscited by 7
- 2025PAGE-4D: Disentangled pose and geometry estimation for vggt-4d perceptioncited by 7
- 2025Emergent Extreme-View Geometry in 3D Foundation Modelscited by 5
- 2026MegaFlow: Zero-Shot Large Displacement Optical Flowcited by 5
- 2025Advances in 4D Representation: Geometry, Motion, and Interactioncited by 4
- 2026UFO-4D: Unposed Feedforward 4D Reconstruction from Two Imagescited by 4
- 2026SLARM: Streaming and Language-Aligned Reconstruction Model for Dynamic Scenescited by 3
- 2026Fast Spatial Memory with Elastic Test-Time Trainingcited by 3
- 2025HuPrior3R: Incorporating Human Priors for Better 3D Dynamic Reconstruction from Monocular Videoscited by 2
12 most cited of 25 All 25 (JSON)
- 2026A Compact Explicit 4D Representation for Dynamic Scenes1 Oct 2026
- 2026Eulerian Motion Reconstruction for Water Scenery29 Sep 2026
- 2026VideoTok4D: A 4D-Aware Video Tokenizer for Compact World Representation11 Sep 2026
- 2026UniQuery4R: Unified 4D Scene Reconstruction from a Single Query18 Aug 2026
- 2026Unified Panoramic-Gaussian Representation for Monocular 4D Scene Synthesis2 Jul 2026
- 2026World from Motion: Generative Dynamic Gaussian Reconstruction from Monocular Video1 Jul 2026
- 2026Envision4D: Envisioning Visual Futures via Feed-forward 4D Gaussian Splatting for Autonomous Driving9 Jun 2026
- 20264D Reconstruction from Sparse Dynamic Cameras3 Jun 2026
- 2026Learning Global Motion with Compact Gaussians for Feed-Forward 4D Reconstruction29 May 2026
- 2026RiGS: Rigid-aware 4D Gaussian Splatting from a Single Monocular Video22 May 2026
- 2026No Pose, No Problem in 4D: Feed-Forward Dynamic Gaussians from Unposed Multi-View Videos21 May 2026
- 2026Face Anything: 4D Face Reconstruction from Any Image Sequence21 Apr 2026
12 newest of 25 All 25 (JSON)