Native 3D Editing with Full Attention
Not on the map. Why?
Abstract (arXiv)
Instruction-guided 3D editing is a rapidly emerging field with the potential to broaden access to 3D content creation. However, existing methods face critical limitations: optimization-based approaches are prohibitively slow, while feed-forward approaches relying on multi-view 2D editing often suffer from inconsistent geometry and degraded visual quality. To address these issues, we propose a novel native 3D editing framework that directly manipulates 3D representations in a single, efficient feed-forward pass. Specifically, we create a large-scale, multi-modal dataset for instruction-guided 3D editing, covering diverse addition, deletion, and modification tasks. This dataset is meticulously curated to ensure that edited objects faithfully adhere to the instructional changes while preserving the consistency of unedited regions with the source object. Building upon this dataset, we explore two distinct conditioning strategies for our model: a conventional cross-attention mechanism and a novel 3D token concatenation approach. Our results demonstrate that token concatenation is more parameter-efficient and achieves superior performance. Extensive evaluations show that our method outperforms existing 2D-lifting approaches, setting a new benchmark in generation quality, 3D consistency, and instruction fidelity.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 45 of its 47 references that are in the map. First posted on arXiv 21 Nov 2025.
Builds on
45 of 47 references.
References · 45
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
- 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,025
- 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,611
- 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Modelscited by 1,464
- 2022Magic3D: High-Resolution Text-to-3D Content Creationcited by 1,290
- 2018Towards Accurate Generative Models of Video: A New Metric & Challengescited by 1,234
- 2023LRM: Large Reconstruction Model for Single Image to 3Dcited by 849
- 2023Objaverse-XL: A Universe of 10M+ 3D Objectscited by 774
- 2024Structured 3D Latents for Scalable and Versatile 3D Generationcited by 770
33 more
- 2024LGM: Large Multi-View Gaussian Model for High-Resolution 3D Content Creationcited by 739
- 2023Wonder3D: Single Image to 3D using Cross-Domain Diffusioncited by 689
- 2023One-2-3-45: Any Single Image to 3D Mesh in 45 Seconds without Per-Shape Optimizationcited by 560
- 2023Instruct-NeRF2NeRF: Editing 3D Scenes with Instructionscited by 484
- 2024InstantMesh: Efficient 3D Mesh Generation from a Single Image with Sparse-view Large Reconstruction Modelscited by 433
- 2023Instant3D: Fast Text-to-3D with Sparse-View Generation and Large Reconstruction Modelcited by 378
- 2021ABO: Dataset and Benchmarks for Real-World 3D Object Understandingcited by 366
- 20203D-FUTURE: 3D Furniture shape with TextUREcited by 311
- 2023RealFusion: 360deg Reconstruction of Any Object from a Single Imagecited by 306
- 2024GRM: Large Gaussian Reconstruction Model for Efficient 3D Reconstruction and Generationcited by 301
- 2023LucidDreamer: Domain-free Generation of 3D Gaussian Splatting Scenescited by 231
- 2023Habitat Synthetic Scenes Dataset (HSSD-200): An Analysis of 3D Scene Scale and Realism Tradeoffs for ObjectGoal Navigationcited by 167
- 2025Hunyuan3D 2.1: From Images to High-Fidelity 3D Assets with Production-Ready PBR Materialcited by 165
- 2023DreamEditor: Text-Driven 3D Scene Editing with Neural Fieldscited by 155
- 2022Dream3D: Zero-Shot Text-to-3D Synthesis Using 3D Shape Prior and Text-to-Image Diffusion Modelscited by 151
- 2024CraftsMan3D: High-fidelity Mesh Generation with 3D Native Generation and Interactive Geometry Refinercited by 123
- 2023Delta Denoising Scorecited by 121
- 2023Vox-E: Text-guided Voxel Editing of 3D Objectscited by 115
- 2024MeshXL: Neural Coordinate Field for Generative 3D Foundation Modelscited by 103
- 2025Step1X-3D: Towards High-Fidelity and Controllable Generation of Textured 3D Assetscited by 87
- 2024TIP-Editor: An Accurate 3D Editor Following Both Text-Prompts And Image-Promptscited by 77
- 2023FocalDreamer: Text-driven 3D Editing via Focal-fusion Assemblycited by 76
- 2024Generic 3D Diffusion Adapter Using Controlled Multi-View Editingcited by 47
- 2025VoxHammer: Training-Free Precise and Coherent 3D Editing in Native 3D Spacecited by 45
- 2024Instant3dit: Multiview Inpainting for Fast Editing of 3D Objectscited by 44
- 2025ShapeLLM-Omni: A Native Multimodal LLM for 3D Generation and Understandingcited by 38
- 2023SHAP-EDITOR: Instruction-guided Latent 3D Editing in Secondscited by 37
- 2024Tailor3D: Customized 3D Assets Editing and Generation with Dual-Side Imagescited by 35
- 2024PrEditor3D: Fast and Precise 3D Shape Editingcited by 28
- 2025EditP23: 3D Editing via Propagation of Image Prompts to Multi-Viewcited by 20
- 2025MeshLLM: Empowering Large Language Models to Progressively Understand and Generate 3D Meshcited by 20
- 2024Chat-Edit-3D: Interactive 3D Scene Editing via Text Promptscited by 19
- 2023Inpaint3D: 3D Scene Content Generation using 2D Inpainting Diffusioncited by 13
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 20263DMorph: Single-Image-Guided Local 3D Shape Editing and Morphingcited by 0
- 2026Hunyuan3D-Buffalo 1.0: A Unified Multimodal Model for Scalable 3D Generation, Understanding, and Editingcited by 0
- 2026Learning 3D Editing without Paired Supervision via Generative Prior Distillationcited by 0
- 2026UMAS3D: Unified Mask-Free 3D Editing with Region-Adaptive Source Preservationcited by 0
- 2026UMAS3D: Unified Mask-Free 3D Editing with Region-Adaptive Source Preservation11 Oct 2026
- 2026Learning 3D Editing without Paired Supervision via Generative Prior Distillation4 Sep 2026
- 2026Hunyuan3D-Buffalo 1.0: A Unified Multimodal Model for Scalable 3D Generation, Understanding, and Editing3 Aug 2026
- 20263DMorph: Single-Image-Guided Local 3D Shape Editing and Morphing5 Jun 2026