Preserve, Reveal, Expand: Faithful 4D Video Editing with Region-Aware Conditioning
On the map: Diffusion models → Video generation
Abstract (arXiv)
While 4D-driven video diffusion models can generate visually plausible videos, faithful 4D editing poses a stricter requirement: source-observed content should be preserved, while disoccluded and out-of-view regions must be synthesized naturally. We identify a key failure mode in existing methods, which we term Evidence-Role Mismatch: source-backed observations, uncertain rendered cues, and unsupported regions are entangled within a single conditioning signal, which can lead to preservation drift, ghosting, and unstable extrapolation. To mitigate this issue, we propose PREX (Preserve, Reveal, Expand), a region-aware framework that decomposes the target spatiotemporal volume into three distinct roles based on observation support and scene extent. PREX traces edited 4D points back to source frames and retrieves observed colors and pairs these appearance cues with geometry-aware confidence and region roles, and injects them into a frozen video diffusion backbone through an adapter trained with self-supervised proxy editing tasks. We further introduce PREBench, a diagnostic benchmark specifically designed for 4D video editing, to expose and quantify such region-specific failures. PREBench separately evaluates Preserve fidelity, Reveal quality, and Expand plausibility of videos generated by 4D driven video diffusion models. Experiments show that PREX substantially reduces region-specific failure modes while maintaining strong visual quality and 4D edit control compared with existing 4D-based video diffusion methods. Code will be publicly released. Project Page: https://ricepastem.github.io/PREX-Open
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Video generation, one of 14 directions in Diffusion models. Builds on 43 of its 44 references that are in the map. First posted on arXiv 20 May 2026.
Builds on
43 of 44 references.
Closest ancestors · 8
Same direction, newest first
- 2025VACE: All-in-One Video Creation and Editing10 Mar
- 2025MotionCanvas: Cinematic Shot Design with Controllable Image-to-Video Generation6 Feb
- 2025Diffusion as Shader: 3D-aware Video Diffusion for Versatile Video Generation Control7 Jan
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformer12 Aug
- 2024CameraCtrl: Enabling Camera Control for Text-to-Video Generation2 Apr
- 2023VidToMe: Video Token Merging for Zero-Shot Video Editing17 Dec
- 2023Rerender A Video: Zero-Shot Text-Guided Video-to-Video Translation13 Jun
- 2023FateZero: Fusing Attentions for Zero-shot Text-based Video Editing16 Mar
Other references · 35
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
- 20234D Gaussian Splatting for Real-Time Dynamic Scene Renderingcited by 1,157
- 2023MotionCtrl: A Unified and Flexible Motion Controller for Video Generationcited by 580
- 2023CoTracker: It is Better to Track Togethercited by 522
- 2023TokenFlow: Consistent Diffusion Features for Consistent Video Editingcited by 442
- 2024ViewCrafter: Taming Video Diffusion Models for High-fidelity Novel View Synthesiscited by 403
- 2025GEN3C: 3D-Informed World-Consistent Video Generation with Precise Camera Controlcited by 341
- 2023ReconFusion: 3D Reconstruction with Diffusion Priorscited by 318
- 2025ReCamMaster: Camera-Controlled Generative Rendering from A Single Videocited by 287
- 2023DragNUWA: Fine-grained Control in Video Generation by Integrating Text, Image, and Trajectorycited by 264
- 2023ProPainter: Improving Propagation and Transformer for Video Inpaintingcited by 197
23 more
- 2024SpatialTracker: Tracking Any 2D Pixels in 3D Spacecited by 181
- 2024DragAnything: Motion Control for Anything using Entity Representationcited by 159
- 2024Recent Advances in 3D Gaussian Splattingcited by 131
- 2024Boximator: Generating Rich and Controllable Motions for Video Synthesiscited by 107
- 2025Voyager: Long-Range and World-Consistent Video Diffusion for Explorable 3D Scene Generationcited by 101
- 2025Yume: An Interactive World Generation Modelcited by 81
- 2025MagicMotion: Controllable Video Generation with Dense-to-Sparse Trajectory Guidancecited by 61
- 2026NeoVerse: Enhancing 4D World Model with in-the-wild Monocular Videoscited by 46
- 2025Wan-Move: Motion-controllable Video Generation via Latent Trajectory Guidancecited by 45
- 2025ATI: Any Trajectory Instruction for Controllable Video Generationcited by 43
- 2025DeepVerse: 4D Autoregressive Video Generation as a World Modelcited by 40
- 2024VideoDirector: Precise Video Editing via Text-to-Video Modelscited by 36
- 2025Trace Anything: Representing Any Video in 4D via Trajectory Fieldscited by 33
- 2025FlashWorld: High-quality 3D Scene Generation within Secondscited by 32
- 2025MotionPro: A Precise Motion Controller for Image-to-Video Generationcited by 30
- 2025Uni4D: Unifying Visual Foundation Models for 4D Modeling from a Single Videocited by 29
- 2026VerseCrafter: Dynamic Realistic Video World Model with 4D Geometric Controlcited by 28
- 2025Perception-as-Control: Fine-grained Controllable Image Animation with 3D-aware Motion Representationcited by 23
- 2025Generative Video Motion Editing with 3D Point Trackscited by 23
- 2026Vista4D: Video Reshooting with 4D Point Cloudscited by 18
- 2025MotionV2V: Editing Motion in a Videocited by 14
- 2025TrackingWorld: World-centric Monocular 3D Tracking of Almost All Pixelscited by 7
- 2025FlexTraj: Image-to-Video Generation with Flexible Point Trajectory Controlcited by 6
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2025V2Edit: Versatile Video Diffusion Editor for Videos and 3D Scenes
- 2025Dynamic-eDiTor: Training-Free Text-Driven 4D Scene Editing with Multimodal Diffusion Transformer
- 2023DiffusionAtlas: High-Fidelity Consistent Diffusion Video Editing
- 2026Beyond Pixels: From Video Priors to 4D Worlds
- 2025Taming Video Models for 3D and 4D Generation via Zero-Shot Camera Control
- 20264DAnyone: Create Anyone in 4D from a Casual Monocular Video
- 2025Tinker: Diffusion's Gift to 3D--Multi-View Consistent Editing From Sparse Inputs without Per-Scene Optimization
- 2025Diff4Splat: Controllable 4D Scene Generation with Latent Dynamic Reconstruction Models