Fast Multi-view Consistent 3D Editing with Video Priors
Not on the map. Why?
Abstract (arXiv)
Text-driven 3D editing enables user-friendly 3D object or scene editing with text instructions. Due to the lack of multi-view consistency priors, existing methods typically resort to employing 2D generation or editing models to process each view individually, followed by iterative 2D-3D-2D updating. However, these methods are not only time-consuming but also prone to over-smoothed results because the different editing signals gathered from different views are averaged during the iterative process. In this paper, we propose generative Video Prior based 3D Editing (ViP3DE) to employ the temporal consistency priors from pre-trained video generation models for multi-view consistent 3D editing in a single forward pass. Our key insight is to condition the video generation model on a single edited view to generate other consistent edited views for 3D updating directly, thereby bypassing the iterative editing paradigm. Since 3D updating requires edited views to be paired with specific camera poses, we propose motion-preserved noise blending for the video model to generate edited views at predefined camera poses. In addition, we introduce geometry-aware denoising to further enhance multi-view consistency by integrating 3D geometric priors into video models. Extensive experiments demonstrate that our proposed ViP3DE can achieve high-quality 3D editing results even within a single forward pass, significantly outperforming existing methods in both editing quality and speed.
Key facts. Cited by 12 papers in the map (data through 7 Oct 2026). Builds on 70 of its 82 references that are in the map. First posted on arXiv 28 Nov 2025.
Builds on
70 of 82 references.
References · 70
- 2017Attention Is All You Needcited by 59,932
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2023GPT-4 Technical Reportcited by 18,132
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2023Segment Anythingcited by 8,158
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
- 2022Classifier-Free Diffusion Guidancecited by 5,717
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
- 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,006
- 2022Elucidating the Design Space of Diffusion-Based Generative Modelscited by 2,994
38 more
- 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,591
- 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,526
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,198
- 2021Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance Fieldscited by 2,013
- 20163D U-Net: Learning Dense Volumetric Segmentation from Sparse Annotationcited by 1,471
- 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuningcited by 1,418
- 2022Null-text Inversion for Editing Real Images using Guided Diffusion Modelscited by 1,168
- 2022Tune-A-Video: One-Shot Tuning of Image Diffusion Models for Text-to-Video Generationcited by 958
- 2024WorldSimBench: Towards Video Generation Models as World Simulatorscited by 867
- 2024Open-Sora: Democratizing Efficient Video Production for Allcited by 637
- 2023MotionCtrl: A Unified and Flexible Motion Controller for Video Generationcited by 568
- 2024VideoCrafter2: Overcoming Data Limitations for High-Quality Video Diffusion Modelscited by 568
- 2023Instruct-NeRF2NeRF: Editing 3D Scenes with Instructionscited by 482
- 2025VACE: All-in-One Video Creation and Editingcited by 467
- 2023FateZero: Fusing Attentions for Zero-shot Text-based Video Editingcited by 462
- 2024CameraCtrl: Enabling Camera Control for Text-to-Video Generationcited by 448
- 2023TokenFlow: Consistent Diffusion Features for Consistent Video Editingcited by 440
- 2021CLIP-NeRF: Text-and-Image Driven Manipulation of Neural Radiance Fieldscited by 369
- 2023I2VGen-XL: High-Quality Image-to-Video Synthesis via Cascaded Diffusion Modelscited by 343
- 2023GaussianEditor: Swift and Controllable 3D Editing with Gaussian Splattingcited by 331
- 2023ControlVideo: Training-free Controllable Text-to-Video Generationcited by 324
- 2024Motion-I2V: Consistent and Controllable Image-to-Video Generation with Explicit Motion Modelingcited by 209
- 2024How Far is Video Generation from World Model: A Physical Law Perspectivecited by 204
- 2023DreamEditor: Text-Driven 3D Scene Editing with Neural Fieldscited by 154
- 2022NeRF-Art: Text-Driven Neural Radiance Fields Stylizationcited by 126
- 2023Vox-E: Text-guided Voxel Editing of 3D Objectscited by 114
- 2024GaussCtrl: Multi-View Consistent Text-Driven 3D Gaussian Splatting Editingcited by 114
- 2023CoDeF: Content Deformation Fields for Temporally Consistent Video Processingcited by 108
- 2024MotionClone: Training-Free Motion Cloning for Controllable Video Generationcited by 104
- 2024DGE: Direct Gaussian 3D Editing by Consistent Multi-view Editingcited by 92
- 2023FocalDreamer: Text-driven 3D Editing via Focal-fusion Assemblycited by 75
- 2023EpiDiff: Enhancing Multi-View Synthesis via Localized Epipolar-Constrained Diffusioncited by 72
- 2023VideoSwap: Customized Video Subject Swapping with Interactive Semantic Point Correspondencecited by 69
- 2024ViCA-NeRF: View-Consistency-Aware 3D Editing of Neural Radiance Fieldscited by 68
- 2024Voxel Mamba: Group-Free State Space Models for Point Cloud based 3D Object Detectioncited by 66
- 2025InsViE-1M: Effective Instruction-based Video Editing with Elaborate Dataset Constructioncited by 62
- 2024I2VEdit: First-Frame-Guided Video Editing via Image-to-Video Diffusion Modelscited by 55
- 2023Progressive3D: Progressively Local Editing for Text-to-3D Content Creation with Complex Semantic Promptscited by 51
50 most cited of 70 All 70 (JSON)
Built on by
Citing papers per year: 2025: 2; 2026: 10.
12 papers.
- 2026One2Scene: Geometric Consistent Explorable 3D Scene Generation from a Single Imagecited by 10
- 2026Omni-3DEdit: Generalized Versatile 3D Editing in One-Passcited by 6
- 2025BEVDilation: LiDAR-Centric Multi-Modal Fusion for 3D Object Detectioncited by 4
- 2026EffectMaker: Unifying Reasoning and Generation for Customized Visual Effect Creationcited by 2
- 2026TRACE: High-Fidelity 3D Scene Editing via Tangible Reconstruction and Geometry-Aligned Contextual Video Maskingcited by 2
- 2025Photo3D: Advancing Photorealistic 3D Generation through Structure-Aligned Detail Enhancementcited by 1
- 2026SceneExpander: Text-Guided 3D Scene Expansion via Free-Form View Insertioncited by 0
- 2026View-Consistent 3D Scene Editing via Dual-Path Structural Correspondense and Semantic Continuitycited by 0
- 2026FluSplat: Sparse-View 3D Editing without Test-Time Optimizationcited by 0
- 2026GeM-NR: Geometry-Aware Multi-View Editing for Nonrigid Scene Changescited by 0
- 2026DepthMaster: Unified Monocular Depth Estimation for Perspective and Panoramic Imagescited by 0
- 2026From Sparse and Imperfect 2D Anchors to Consistent 3D Gaussian Street Scenes: Support-Aware Appearancecited by 0
- 2026From Sparse and Imperfect 2D Anchors to Consistent 3D Gaussian Street Scenes: Support-Aware Appearance24 Jun 2026
- 2026DepthMaster: Unified Monocular Depth Estimation for Perspective and Panoramic Images10 Jun 2026
- 2026GeM-NR: Geometry-Aware Multi-View Editing for Nonrigid Scene Changes3 Jun 2026
- 2026FluSplat: Sparse-View 3D Editing without Test-Time Optimization21 Apr 2026
- 2026View-Consistent 3D Scene Editing via Dual-Path Structural Correspondense and Semantic Continuity20 Apr 2026
- 2026TRACE: High-Fidelity 3D Scene Editing via Tangible Reconstruction and Geometry-Aligned Contextual Video Masking1 Apr 2026
- 2026SceneExpander: Text-Guided 3D Scene Expansion via Free-Form View Insertion28 Mar 2026
- 2026Omni-3DEdit: Generalized Versatile 3D Editing in One-Pass18 Mar 2026
- 2026EffectMaker: Unifying Reasoning and Generation for Customized Visual Effect Creation6 Mar 2026
- 2026One2Scene: Geometric Consistent Explorable 3D Scene Generation from a Single Image23 Feb 2026
- 2025Photo3D: Advancing Photorealistic 3D Generation through Structure-Aligned Detail Enhancement9 Dec 2025
- 2025BEVDilation: LiDAR-Centric Multi-Modal Fusion for 3D Object Detection2 Dec 2025