Vista4D: Video Reshooting with 4D Point Clouds
Not on the map. Why?
Abstract (arXiv)
We present Vista4D, a robust and flexible video reshooting framework that grounds the input video and target cameras in a 4D point cloud. Specifically, given an input video, our method re-synthesizes the scene with the same dynamics from a different camera trajectory and viewpoint. Existing video reshooting methods often struggle with depth estimation artifacts of real-world dynamic videos, while also failing to preserve content appearance and failing to maintain precise camera control for challenging new trajectories. We build a 4D-grounded point cloud representation with static pixel segmentation and 4D reconstruction to explicitly preserve seen content and provide rich camera signals, and we train with reconstructed multiview dynamic data for robustness against point cloud artifacts during real-world inference. Our results demonstrate improved 4D consistency, camera control, and visual quality compared to state-of-the-art baselines under a variety of videos and camera paths. Moreover, our method generalizes to real-world applications such as dynamic scene expansion and 4D scene recomposition. See our project page for results, code, and models: https://eyeline-labs.github.io/Vista4D
Key facts. Cited by 18 papers in the map (data through 14 Oct 2026). Builds on 58 of its 71 references that are in the map. First posted on arXiv 23 Apr 2026.
Builds on
58 of 71 references.
References · 58
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
- 2022Scalable Diffusion Models with Transformerscited by 6,054
- 2022Flow Matching for Generative Modelingcited by 5,702
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
- 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,822
- 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,660
- 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,567
- 2025VGGT: Visual Geometry Grounded Transformercited by 1,539
- 2019SuperGlue: Learning Feature Matching with Graph Neural Networkscited by 1,443
- 2017SuperPoint: Self-Supervised Interest Point Detection and Descriptioncited by 1,320
- 2023MVDream: Multi-view Diffusion for 3D Generationcited by 938
38 more
- 2024Grounded SAM: Assembling Open-World Models for Diverse Visual Taskscited by 929
- 2021DROID-SLAM: Deep Visual SLAM for Monocular, Stereo, and RGB-D Camerascited by 687
- 2023LightGlue: Local Feature Matching at Light Speedcited by 590
- 2025Continuous 3D Perception Model with Persistent Statecited by 548
- 2024CameraCtrl: Enabling Camera Control for Text-to-Video Generationcited by 460
- 2024SV3D: Novel Multi-view Synthesis and 3D Generation from a Single Image using Latent Video Diffusioncited by 364
- 2024OpenVid-1M: A Large-Scale High-Quality Dataset for Text-to-video Generationcited by 341
- 2025VBench-2.0: Advancing Video Generation Benchmark Suite for Intrinsic Faithfulnesscited by 315
- 2025MapAnything: Universal Feed-Forward Metric 3D Reconstructioncited by 314
- 2023Recognize Anything: A Strong Image Tagging Modelcited by 309
- 2025ReCamMaster: Camera-Controlled Generative Rendering from A Single Videocited by 287
- 2025MoGe-2: Accurate Monocular Geometry with Metric Scale and Sharp Detailscited by 261
- 2024Shape of Motion: 4D Reconstruction from a Single Videocited by 250
- 2024MegaSaM: Accurate, Fast, and Robust Structure and Motion from Casual Dynamic Videoscited by 228
- 2023Visual Geometry Grounded Deep Structure From Motioncited by 227
- 2024Global Structure-from-Motion Revisitedcited by 218
- 2025Video Depth Anything: Consistent Depth Estimation for Super-Long Videoscited by 207
- 2024DepthCrafter: Generating Consistent Long Depth Sequences for Open-world Videoscited by 204
- 2022Monocular Dynamic View Synthesis: A Reality Checkcited by 200
- 2025Stable Virtual Camera: Generative View Synthesis with Diffusion Modelscited by 182
- 2024MoSca: Dynamic Gaussian Fusion from Casual Videos via 4D Motion Scaffoldscited by 179
- 2024SEA-RAFT: Simple, Efficient, Accurate RAFT for Optical Flowcited by 174
- 2025UniDepthV2: Universal Monocular Metric Depth Estimation Made Simplercited by 173
- 2025Streaming 4D Visual Geometry Transformercited by 161
- 2024VD3D: Taming Large Video Diffusion Transformers for 3D Camera Controlcited by 156
- 2024SV4D: Dynamic 3D Content Generation with Multi-Frame and Multi-View Consistencycited by 144
- 2024Generative Camera Dolly: Extreme Monocular Dynamic Novel View Synthesiscited by 117
- 2024Collaborative Video Diffusion: Consistent Multi-video Generation with Camera Controlcited by 117
- 2025Go-with-the-Flow: Motion-Controllable Video Diffusion Models Using Real-Time Warped Noisecited by 117
- 2025STream3R: Scalable Sequential 3D Reconstruction with Causal Transformercited by 82
- 2024NVS-Solver: Video Diffusion Model as Zero-Shot Novel View Synthesizercited by 79
- 2024MultiDiff: Consistent Novel View Synthesis from a Single Imagecited by 68
- 2025Geo4D: Leveraging Video Generators for Geometric 4D Scene Reconstructioncited by 67
- 2024Trajectory Attention for Fine-grained Video Motion Controlcited by 63
- 2024SPAD : Spatially Aware Multiview Diffuserscited by 62
- 2024GFlow: Recovering 4D World from Monocular Videocited by 46
- 2025CamCloneMaster: Enabling Reference-based Camera Control for Video Generationcited by 46
- 2025GeometryCrafter: Consistent Geometry Estimation for Open-world Videos with Diffusion Priorscited by 37
50 most cited of 58 All 58 (JSON)
Built on by
Citing papers per year: 2026: 18.
18 papers.
Sort:
By area:
- 2026SierpinskiCam: Camera-Controlled Video Retaking with Sierpinski Triangle Pattern Cuescited by 2
- 2026OpenLongTail: Generative Scaling of Long-Tail Driving Datacited by 2
- 2026Grounded-Exo2Ego: Structured Semantic Grounding for Robust Exocentric-to-Egocentric Video Generationcited by 2
- 2026EditStream: A Unified Autoregressive Framework for Interactive Video Generation and Editingcited by 2
- 2026Preserve, Reveal, Expand: Faithful 4D Video Editing with Region-Aware Conditioningcited by 1
- 2026Auteur: Language-Driven Cinematographic Framing for Human-Centric Video Generationcited by 1
- 2026TARS: Timestep-Aware Data Scaling for 3D-Free Video Re-Shootingcited by 1
- 2026World from Motion: Generative Dynamic Gaussian Reconstruction from Monocular Videocited by 0
- 2026PE-Field 4D: Video Generation Models as Canvascited by 0
- 2026Manifold4D: Denoising on Point Cloud Rendered Manifolds for Video Re-shootingcited by 0
- 2026FlashRender: Few-Step Generative Rendering via Camera-Controlled Video MeanFlowcited by 0
- 2026World in World: Explore the World with World Modelscited by 0
6 more
- 2026Exo2EgoHOI: Hand-Object-Interaction Aware Exocentric-to-Egocentric Video Generationcited by 0
- 2026Eulerian Motion Reconstruction for Water Scenerycited by 0
- 2026Generative Cinematographer: Composing Camera and Object Motion in 3Dcited by 0
- 2026SemCam: Semantic Camera Motion Control for Video Generationcited by 0
- 20264LC: 4D Latent Cache for Efficient Conditioning in Dynamic World Modelingcited by 0
- 2026Any Time, Any Space: A World-State-Centric Framework for Agentic Video Generationcited by 0
- 2026Any Time, Any Space: A World-State-Centric Framework for Agentic Video Generation14 Oct 2026
- 20264LC: 4D Latent Cache for Efficient Conditioning in Dynamic World Modeling13 Oct 2026
- 2026SemCam: Semantic Camera Motion Control for Video Generation4 Oct 2026
- 2026Generative Cinematographer: Composing Camera and Object Motion in 3D1 Oct 2026
- 2026Eulerian Motion Reconstruction for Water Scenery29 Sep 2026
- 2026Exo2EgoHOI: Hand-Object-Interaction Aware Exocentric-to-Egocentric Video Generation29 Sep 2026
- 2026World in World: Explore the World with World Models10 Sep 2026
- 2026FlashRender: Few-Step Generative Rendering via Camera-Controlled Video MeanFlow3 Sep 2026
- 2026Manifold4D: Denoising on Point Cloud Rendered Manifolds for Video Re-shooting28 Aug 2026
- 2026Grounded-Exo2Ego: Structured Semantic Grounding for Robust Exocentric-to-Egocentric Video Generation20 Aug 2026
- 2026EditStream: A Unified Autoregressive Framework for Interactive Video Generation and Editing16 Aug 2026
- 2026TARS: Timestep-Aware Data Scaling for 3D-Free Video Re-Shooting30 Jul 2026
6 more
- 2026PE-Field 4D: Video Generation Models as Canvas17 Jul 2026
- 2026OpenLongTail: Generative Scaling of Long-Tail Driving Data10 Jul 2026
- 2026World from Motion: Generative Dynamic Gaussian Reconstruction from Monocular Video1 Jul 2026
- 2026SierpinskiCam: Camera-Controlled Video Retaking with Sierpinski Triangle Pattern Cues15 Jun 2026
- 2026Auteur: Language-Driven Cinematographic Framing for Human-Centric Video Generation1 Jun 2026
- 2026Preserve, Reveal, Expand: Faithful 4D Video Editing with Region-Aware Conditioning20 May 2026
- 2026SierpinskiCam: Camera-Controlled Video Retaking with Sierpinski Triangle Pattern Cuescited by 2
- 2026Grounded-Exo2Ego: Structured Semantic Grounding for Robust Exocentric-to-Egocentric Video Generationcited by 2
- 2026EditStream: A Unified Autoregressive Framework for Interactive Video Generation and Editingcited by 2
- 2026Auteur: Language-Driven Cinematographic Framing for Human-Centric Video Generationcited by 1
- 2026TARS: Timestep-Aware Data Scaling for 3D-Free Video Re-Shootingcited by 1
- 2026World from Motion: Generative Dynamic Gaussian Reconstruction from Monocular Videocited by 0
- 2026Manifold4D: Denoising on Point Cloud Rendered Manifolds for Video Re-shootingcited by 0
- 2026FlashRender: Few-Step Generative Rendering via Camera-Controlled Video MeanFlowcited by 0
- 2026Exo2EgoHOI: Hand-Object-Interaction Aware Exocentric-to-Egocentric Video Generationcited by 0
- 2026Eulerian Motion Reconstruction for Water Scenerycited by 0
- 2026Generative Cinematographer: Composing Camera and Object Motion in 3Dcited by 0
- 2026SemCam: Semantic Camera Motion Control for Video Generationcited by 0
- 2026SemCam: Semantic Camera Motion Control for Video Generation4 Oct 2026
- 2026Generative Cinematographer: Composing Camera and Object Motion in 3D1 Oct 2026
- 2026Eulerian Motion Reconstruction for Water Scenery29 Sep 2026
- 2026Exo2EgoHOI: Hand-Object-Interaction Aware Exocentric-to-Egocentric Video Generation29 Sep 2026
- 2026FlashRender: Few-Step Generative Rendering via Camera-Controlled Video MeanFlow3 Sep 2026
- 2026Manifold4D: Denoising on Point Cloud Rendered Manifolds for Video Re-shooting28 Aug 2026
- 2026Grounded-Exo2Ego: Structured Semantic Grounding for Robust Exocentric-to-Egocentric Video Generation20 Aug 2026
- 2026EditStream: A Unified Autoregressive Framework for Interactive Video Generation and Editing16 Aug 2026
- 2026TARS: Timestep-Aware Data Scaling for 3D-Free Video Re-Shooting30 Jul 2026
- 2026World from Motion: Generative Dynamic Gaussian Reconstruction from Monocular Video1 Jul 2026
- 2026SierpinskiCam: Camera-Controlled Video Retaking with Sierpinski Triangle Pattern Cues15 Jun 2026
- 2026Auteur: Language-Driven Cinematographic Framing for Human-Centric Video Generation1 Jun 2026