Towards Scalable and Consistent 3D Editing
Not on the map. Why?
Abstract (arXiv)
3D editing - the task of locally modifying the geometry or appearance of a 3D asset - has wide applications in immersive content creation, digital entertainment, and AR/VR. However, unlike 2D editing, it remains challenging due to the need for cross-view consistency, structural fidelity, and fine-grained controllability. Existing approaches are often slow, prone to geometric distortions, or dependent on manual and accurate 3D masks that are error-prone and impractical. To address these challenges, we advance both the data and model fronts. On the data side, we introduce 3DEditVerse, the largest paired 3D editing benchmark to date, comprising 116,309 high-quality training pairs and 1,500 curated test pairs. Built through complementary pipelines of pose-driven geometric edits and foundation model-guided appearance edits, 3DEditVerse ensures edit locality, multi-view consistency, and semantic alignment. On the model side, we propose 3DEditFormer, a 3D-structure-preserving conditional transformer. By enhancing image-to-3D generation with dual-guidance attention and time-adaptive gating, 3DEditFormer disentangles editable regions from preserved structure, enabling precise and consistent edits without requiring auxiliary 3D masks. Extensive experiments demonstrate that our framework outperforms state-of-the-art baselines both quantitatively and qualitatively, establishing a new standard for practical and scalable 3D editing. Dataset and code will be released. Project: https://www.lv-lab.org/3DEditFormer/
Key facts. Cited by 10 papers in the map (data through 14 Oct 2026). Builds on 48 of its 57 references that are in the map. First posted on arXiv 3 Oct 2025.
Builds on
48 of 57 references.
References · 48
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
- 2022Flow Matching for Generative Modelingcited by 5,702
- 2022Generative Adversarial Networkscited by 5,627
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2024SAM 2: Segment Anything in Images and Videoscited by 2,863
- 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,611
- 2023Zero-1-to-3: Zero-shot One Image to 3D Objectcited by 1,489
36 more
- 2022RePaint: Inpainting using Denoising Diffusion Probabilistic Modelscited by 1,430
- 2021Efficient Geometry-aware 3D Generative Adversarial Networkscited by 1,205
- 2022Imagic: Text-Based Real Image Editing with Diffusion Modelscited by 1,178
- 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Spacecited by 1,006
- 2016A Point Set Generation Network for 3D Object Reconstruction from a Single Imagecited by 979
- 2023Objaverse-XL: A Universe of 10M+ 3D Objectscited by 774
- 2024Structured 3D Latents for Scalable and Versatile 3D Generationcited by 770
- 2022GET3D: A Generative Model of High Quality 3D Textured Shapes Learned from Imagescited by 446
- 2024InstantMesh: Efficient 3D Mesh Generation from a Single Image with Sparse-view Large Reconstruction Modelscited by 433
- 2025Step1X-Edit: A Practical Framework for General Image Editingcited by 429
- 2024GRM: Large Gaussian Reconstruction Model for Efficient 3D Reconstruction and Generationcited by 301
- 2023Text-to-3D using Gaussian Splattingcited by 299
- 20223D Neural Field Generation using Triplane Diffusioncited by 274
- 2024Diffusion Model-Based Image Editing: A Surveycited by 212
- 2024Direct3D: Scalable Image-to-3D Generation via 3D Latent Diffusion Transformercited by 210
- 2024MV-Adapter: Multi-view Consistent Image Generation Made Easycited by 112
- 2024DGE: Direct Gaussian 3D Editing by Consistent Multi-view Editingcited by 94
- 2023Tag2Text: Guiding Vision-Language Model via Image Taggingcited by 86
- 2024Hunyuan3D 1.0: A Unified Framework for Text-to-3D and Image-to-3D Generationcited by 82
- 2024TIP-Editor: An Accurate 3D Editor Following Both Text-Prompts And Image-Promptscited by 77
- 2025SeedEdit 3.0: Fast and High-Quality Generative Image Editingcited by 53
- 2024Generic 3D Diffusion Adapter Using Controlled Multi-View Editingcited by 47
- 2025VoxHammer: Training-Free Precise and Coherent 3D Editing in Native 3D Spacecited by 45
- 2024Instant3dit: Multiview Inpainting for Fast Editing of 3D Objectscited by 44
- 2025ShapeLLM-Omni: A Native Multimodal LLM for 3D Generation and Understandingcited by 38
- 2024Tailor3D: Customized 3D Assets Editing and Generation with Dual-Side Imagescited by 35
- 2024Make-Your-3D: Fast and Consistent Subject-Driven 3D Content Generationcited by 32
- 2024PrEditor3D: Fast and Precise 3D Shape Editingcited by 28
- 2024BlenderAlchemy: Editing 3D Graphics with Vision-Language Modelscited by 22
- 2024Interactive3D: Create What You Want by Interactive 3D Generationcited by 21
- 2025EditP23: 3D Editing via Propagation of Image Prompts to Multi-Viewcited by 20
- 2025CMD: Controllable Multiview Diffusion for 3D Editing and Progressive Generationcited by 14
- 2023Generalizing Single-View 3D Shape Retrieval to Occlusions and Unseen Objectscited by 8
- 2025Rethinking Score Distilling Sampling for 3D Editing and Generationcited by 7
- 2023TPA3D: Triplane Attention for Fast Text-to-3D Generationcited by 6
- 2024Towards a Training Free Approach for 3D Scene Editingcited by 2
Built on by
Citing papers per year: 2025: 1; 2026: 9.
10 papers.
- 2026Feedforward 3D Editing Learns from Semantic-Part Transformationcited by 10
- 2026ShapeUP: Scalable Image-Conditioned 3D Editingcited by 4
- 2026Omni123: Exploring 3D Native Foundation Models with Limited 3D Data by Unifying Text to 2D and 3D Generationcited by 3
- 2025InstructMix2Mix: Consistent Sparse-View Editing Through Multi-View Model Personalizationcited by 1
- 2026EditVerse3D: High-Quality 3D Object Editing with Region-Aware Learningcited by 1
- 20263DMorph: Single-Image-Guided Local 3D Shape Editing and Morphingcited by 0
- 2026Hunyuan3D-Buffalo 1.0: A Unified Multimodal Model for Scalable 3D Generation, Understanding, and Editingcited by 0
- 2026Learning 3D Editing without Paired Supervision via Generative Prior Distillationcited by 0
- 2026Scaling Versatile 3D Assets Editing with a Million-Scale Datasetcited by 0
- 2026UMAS3D: Unified Mask-Free 3D Editing with Region-Adaptive Source Preservationcited by 0
- 2026UMAS3D: Unified Mask-Free 3D Editing with Region-Adaptive Source Preservation11 Oct 2026
- 2026Scaling Versatile 3D Assets Editing with a Million-Scale Dataset28 Sep 2026
- 2026Learning 3D Editing without Paired Supervision via Generative Prior Distillation4 Sep 2026
- 2026Hunyuan3D-Buffalo 1.0: A Unified Multimodal Model for Scalable 3D Generation, Understanding, and Editing3 Aug 2026
- 2026EditVerse3D: High-Quality 3D Object Editing with Region-Aware Learning8 Jul 2026
- 20263DMorph: Single-Image-Guided Local 3D Shape Editing and Morphing5 Jun 2026
- 2026Feedforward 3D Editing Learns from Semantic-Part Transformation26 May 2026
- 2026Omni123: Exploring 3D Native Foundation Models with Limited 3D Data by Unifying Text to 2D and 3D Generation2 Apr 2026
- 2026ShapeUP: Scalable Image-Conditioned 3D Editing5 Feb 2026
- 2025InstructMix2Mix: Consistent Sparse-View Editing Through Multi-View Model Personalization18 Nov 2025