MVTrack4Gen: Multi-View Point Tracking as Geometric Supervision for 4D Video Generation
On the map: Diffusion models → Video generation
Abstract (arXiv)
Synthesizing a novel-view video from a monocular reference video along a target camera trajectory requires both geometric consistency and motion fidelity with respect to the reference video. Existing methods based on explicit 3D representations are limited by the accuracy of off-the-shelf reconstruction modules, which often produce inaccurate geometry for dynamic objects in monocular videos. In contrast, camera-conditioning-only methods can achieve high visual quality but often struggle to preserve geometric and motion consistency. In this work, we introduce MVTrack4Gen (Multi-View point Tracking for Novel-View Generation), a motion-aware training framework that leverages multi-view point tracking as an additional geometric and motion supervision signal for camera-conditioning-only novel-view video diffusion models. Our key finding is that specific attention layers encode strong correspondence cues, where query features attend to key features at geometrically corresponding locations across views and over time, and the misalignment of these correspondences causes motion inconsistency. Based on this observation, we route these features into an auxiliary multi-view tracking head and jointly train the diffusion model with a point-tracking objective. By explicitly strengthening these motion-aware correspondences, MVTrack4Gen improves existing models to better follow the motion in the reference view and maintain cross-view geometric consistency. Across diverse benchmarks, our method achieves state-of-the-art geometric consistency and competitive camera accuracy.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in Video generation, one of 14 directions in Diffusion models. Builds on 41 of its 44 references that are in the map. First posted on arXiv 24 Jun 2026.
Builds on
41 of 44 references.
Closest ancestors · 6
Same direction, newest first
- 2025SpaceTimePilot: Generative Rendering of Dynamic Scenes Across Space and Time31 Dec
- 2025Infinite-Homography as Robust Conditioning for Camera-Controlled Video Generation18 Dec
- 2025Emergent Temporal Correspondences from Video Diffusion Transformers20 Jun
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformer12 Aug
- 2024Lumiere: A Space-Time Diffusion Model for Video Generation23 Jan
- 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasets25 Nov
Other references · 35
- 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,822
- 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,660
- 2025Cosmos World Foundation Model Platform for Physical AIcited by 864
- 2025Depth Anything 3: Recovering the Visual Space from Any Viewscited by 692
- 2023CoTracker: It is Better to Track Togethercited by 522
- 2022Kubric: A scalable dataset generatorcited by 381
- 2025GEN3C: 3D-Informed World-Consistent Video Generation with Precise Camera Controlcited by 341
- 2021Light Field Networks: Neural Scene Representations with Single-Evaluation Renderingcited by 332
- 2023TAPIR: Tracking Any Point with per-frame Initialization and temporal Refinementcited by 287
- 2025ReCamMaster: Camera-Controlled Generative Rendering from A Single Videocited by 287
- 2022TAP-Vid: A Benchmark for Tracking Any Point in a Videocited by 263
- 2022Particle Video Revisited: Tracking Through Occlusions Using Point Trajectoriescited by 217
23 more
- 2022Monocular Dynamic View Synthesis: A Reality Checkcited by 200
- 2024CAT4D: Create Anything in 4D with Multi-View Video Diffusion Modelscited by 161
- 2024CoTracker3: Simpler and Better Point Tracking by Pseudo-Labelling Real Videoscited by 128
- 2025TrajectoryCrafter: Redirecting Camera Trajectory for Monocular Videos via Diffusion Modelscited by 125
- 2024Generative Camera Dolly: Extreme Monocular Dynamic Novel View Synthesiscited by 117
- 2025MEt3R: Measuring Multi-View Consistency in Generated Imagescited by 95
- 2024SynCamMaster: Synchronizing Multi-Camera Video Generation from Diverse Viewpointscited by 93
- 2024Local All-Pair Correspondence for Point Trackingcited by 80
- 2025Uni3C: Unifying Precisely 3D-Enhanced Camera and Human Motion Controls for Video Generationcited by 77
- 2026NeoVerse: Enhancing 4D World Model with in-the-wild Monocular Videoscited by 46
- 2025Spatia: Video Generation with Updatable Spatial Memorycited by 40
- 2025Reangle-A-Video: 4D Video Generation as Video-to-Video Translationcited by 35
- 2025Multi-View 3D Point Trackingcited by 17
- 2025Reconstruct, Inpaint, Test-Time Finetune: Dynamic Novel-view Synthesis from Monocular Videoscited by 14
- 20253D Scene Prompting for Scene-Consistent Camera-Controllable Video Generationcited by 13
- 2026AnyView: Synthesizing Any Novel View in Dynamic Scenescited by 12
- 2025Vivid4D: Improving 4D Reconstruction from Monocular Video by Video Inpaintingcited by 11
- 2025ReDirector: Creating Any-Length Video Retakes with Rotary Camera Encodingcited by 11
- 2025EgoX: Egocentric Video Generation from a Single Exocentric Videocited by 8
- 2025PostCam: Camera-Controllable Novel-View Video Generation with Query-Shared Cross-Attentioncited by 6
- 2025MV-TAP: Tracking Any Point in Multi-View Videoscited by 4
- 2025OmniView: An All-Seeing Diffusion Model for 3D and 4D View Synthesiscited by 4
- 2025ChronosObserver: Taming 4D World with Hyperspace Diffusion Samplingcited by 2
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2026Track2View: 4D-Consistent Camera-Controlled Video Generation via Paired 3D Point Tracks
- 2025Tracking-Guided 4D Generation: Foundation-Tracker Motion Priors for 3D Model Animation
- 2024Track4Gen: Teaching Video Diffusion Models to Track Points Improves Video Generation
- 2025MV-Performer: Taming Video Diffusion Model for Faithful and Synchronized Multi-view Performer Synthesis
- 2026Flex4DHuman: Flexible Multi-view Video Diffusion for 4D Human Reconstruction
- 2024RegTrack: Simplicity Beneath Complexity in Robust Multi-Modal 3D Multi-Object Tracking
- 2025SV4D 2.0: Enhancing Spatio-Temporal Consistency in Multi-View Video Diffusion for High-Quality 4D Generation
- 2025Point Prompting: Counterfactual Tracking with Video Diffusion Models