DisCo3D: Distilling Multi-View Consistency for 3D Scene Editing
On the map: Diffusion models → 3D, point cloud and scene generation
Abstract (arXiv)
While diffusion models have demonstrated remarkable progress in 2D image generation and editing, extending these capabilities to 3D editing remains challenging, particularly in maintaining multi-view consistency. Classical approaches typically update 3D representations through iterative refinement based on a single editing view. However, these methods often suffer from slow convergence and blurry artifacts caused by cross-view inconsistencies. Recent methods improve efficiency by propagating 2D editing attention features, yet still exhibit fine-grained inconsistencies and failure modes in complex scenes due to insufficient constraints. To address this, we propose DisCo3D, a novel framework that distills 3D consistency priors into a 2D editor. Our method first fine-tunes a 3D generator using multi-view inputs for scene adaptation, then trains a 2D editor through consistency distillation. The edited multi-view outputs are finally optimized into 3D representations via Gaussian Splatting. Experimental results show DisCo3D achieves stable multi-view consistency and outperforms state-of-the-art methods in editing quality.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Placed in 3D, point cloud and scene generation, one of 14 directions in Diffusion models. Builds on 55 of its 61 references that are in the map. First posted on arXiv 3 Aug 2025.
Builds on
55 of 61 references.
Closest ancestors · 15
Same direction, newest first
- 2024EditSplat: Multi-View Fusion and Attention-Guided Optimization for View-Consistent 3D Scene Editing with 3D Gaussian Splatting16 Dec
- 2024Diffusion-Based Attention Warping for Consistent 3D Scene Editing10 Dec
- 2024ViewCrafter: Taming Video Diffusion Models for High-fidelity Novel View Synthesis3 Sep
- 2024ConsistDreamer: 3D-Consistent 2D Diffusion for High-Fidelity Scene Editing13 Jun
- 2024NVS-Solver: Video Diffusion Model as Zero-Shot Novel View Synthesizer24 May
- 2024CAT3D: Create Anything in 3D with Multi-View Diffusion Models16 May
- 2024RealmDreamer: Text-Driven 3D Scene Generation with Inpainting and Depth Diffusion10 Apr
- 2023ZeroNVS: Zero-Shot 360-Degree View Synthesis from a Single Image27 Oct
- 2023Progressive3D: Progressively Local Editing for Text-to-3D Content Creation with Complex Semantic Prompts18 Oct
- 2023ED-NeRF: Efficient Text-Guided Editing of 3D Scene with Latent Space NeRF4 Oct
- 2023Edit-DiffNeRF: Editing 3D Neural Radiance Fields using 2D Diffusion Model15 Jun
- 2023ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillation25 May
3 more
Other references · 40
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 2020Denoising Diffusion Implicit Modelscited by 9,781
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
- 2022Classifier-Free Diffusion Guidancecited by 5,847
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
- 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,101
- 2022Elucidating the Design Space of Diffusion-Based Generative Modelscited by 3,045
- 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,611
28 more
- 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,581
- 2022Video Diffusion Modelscited by 2,305
- 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,567
- 2022Objaverse: A Universe of Annotated 3D Objectscited by 1,540
- 2023ImageReward: Learning and Evaluating Human Preferences for Text-to-Image Generationcited by 1,045
- 2023One-step Diffusion with Distribution Matching Distillationcited by 1,019
- 2023Objaverse-XL: A Universe of 10M+ 3D Objectscited by 774
- 2024Improved Distribution Matching Distillation for Fast Image Synthesiscited by 684
- 2021Common Objects in 3D: Large-Scale Learning and Evaluation of Real-life 3D Category Reconstructioncited by 652
- 2023Instruct-NeRF2NeRF: Editing 3D Scenes with Instructionscited by 484
- 2023DynamiCrafter: Animating Open-domain Images with Video Diffusion Priorscited by 471
- 2023GaussianEditor: Swift and Controllable 3D Editing with Gaussian Splattingcited by 335
- 2023LucidDreamer: Domain-free Generation of 3D Gaussian Splatting Scenescited by 231
- 2023MVImgNet: A Large-scale Dataset of Multi-view Imagescited by 220
- 2023MotionDirector: Motion Customization of Text-to-Video Diffusion Modelscited by 173
- 2023Segment Any 3D Gaussianscited by 161
- 2023DreamEditor: Text-Driven 3D Scene Editing with Neural Fieldscited by 155
- 2024GaussCtrl: Multi-View Consistent Text-Driven 3D Gaussian Splatting Editingcited by 115
- 2024DGE: Direct Gaussian 3D Editing by Consistent Multi-view Editingcited by 94
- 2024ViCA-NeRF: View-Consistency-Aware 3D Editing of Neural Radiance Fieldscited by 68
- 2024View-Consistent 3D Editing with Gaussian Splattingcited by 67
- 2024I2VEdit: First-Frame-Guided Video Editing via Image-to-Video Diffusion Modelscited by 55
- 2023Instruct 3D-to-3D: Text Instruction Guided 3D-to-3D conversioncited by 48
- 2024Chat-Edit-3D: Interactive 3D Scene Editing via Text Promptscited by 19
- 2025InterGSEdit: Interactive 3D Gaussian Splatting Editing with 3D Geometry-Consistent Attention Priorcited by 19
- 2023ProteusNeRF: Fast Lightweight NeRF Editing using 3D-Aware Image Contextcited by 17
- 2023InstructP2P: Learning to Edit 3D Point Clouds with Text Instructionscited by 14
- 2024Unified Editing of Panorama, 3D Scenes, and Videos Through Disentangled Self-Attention Injectioncited by 4
Built on by
Citing papers per year: 2025: 2; 2026: 1.
3 papers.
- 2026CompoSE: Compositional Synthesis and Editing of 3D Shapes via Part-Aware Control19 May 2026
- 2025SplatPainter: Interactive Authoring of 3D Gaussians from 2D Edits via Test-Time Training5 Dec 2025
- 2025InstructMix2Mix: Consistent Sparse-View Editing Through Multi-View Model Personalization18 Nov 2025
Similar, not cited
Close in wording, no citation either way
- 2025Tinker: Diffusion's Gift to 3D--Multi-View Consistent Editing From Sparse Inputs without Per-Scene Optimization
- 2024SyncNoise: Geometrically Consistent Noise Prediction for Text-based 3D Scene Editing
- 20243DEgo: 3D Editing on the Go!
- 2024ProEdit: Simple Progression is All You Need for High-Quality 3D Scene Editing
- 2025Edit360: 2D Image Edits to 3D Assets from Any Angle
- 2026Edit in 2D, Verify in 3D: Reinforcement Learning for Multi-view Consistent Scene Editing
- 2023Consistent123: Improve Consistency for One Image to 3D Object Synthesis
- 2025Coupled Diffusion Sampling for Training-Free Multi-View Image Editing