mlsanityData to 14 Oct 2026

Native 3D Editing with Full Attention

arXiv 2511.17501 ↗First posted 21 Nov 2025cs.CV cs.GRcited by 4

Not on the map. Why?

Abstract (arXiv)

Instruction-guided 3D editing is a rapidly emerging field with the potential to broaden access to 3D content creation. However, existing methods face critical limitations: optimization-based approaches are prohibitively slow, while feed-forward approaches relying on multi-view 2D editing often suffer from inconsistent geometry and degraded visual quality. To address these issues, we propose a novel native 3D editing framework that directly manipulates 3D representations in a single, efficient feed-forward pass. Specifically, we create a large-scale, multi-modal dataset for instruction-guided 3D editing, covering diverse addition, deletion, and modification tasks. This dataset is meticulously curated to ensure that edited objects faithfully adhere to the instructional changes while preserving the consistency of unedited regions with the source object. Building upon this dataset, we explore two distinct conditioning strategies for our model: a conventional cross-attention mechanism and a novel 3D token concatenation approach. Our results demonstrate that token concatenation is more parameter-efficient and achieves superior performance. Extensive evaluations show that our method outperforms existing 2D-lifting approaches, setting a new benchmark in generation quality, 3D consistency, and instruction fidelity.

Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 45 of its 47 references that are in the map. First posted on arXiv 21 Nov 2025.

Builds on

45 of 47 references.

References · 45

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  3. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
  4. 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
  5. 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,025
  6. 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,611
  7. 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Modelscited by 1,464
  8. 2022Magic3D: High-Resolution Text-to-3D Content Creationcited by 1,290
  9. 2018Towards Accurate Generative Models of Video: A New Metric & Challengescited by 1,234
  10. 2023LRM: Large Reconstruction Model for Single Image to 3Dcited by 849
  11. 2023Objaverse-XL: A Universe of 10M+ 3D Objectscited by 774
  12. 2024Structured 3D Latents for Scalable and Versatile 3D Generationcited by 770
33 more
  1. 2024LGM: Large Multi-View Gaussian Model for High-Resolution 3D Content Creationcited by 739
  2. 2023Wonder3D: Single Image to 3D using Cross-Domain Diffusioncited by 689
  3. 2023One-2-3-45: Any Single Image to 3D Mesh in 45 Seconds without Per-Shape Optimizationcited by 560
  4. 2023Instruct-NeRF2NeRF: Editing 3D Scenes with Instructionscited by 484
  5. 2024InstantMesh: Efficient 3D Mesh Generation from a Single Image with Sparse-view Large Reconstruction Modelscited by 433
  6. 2023Instant3D: Fast Text-to-3D with Sparse-View Generation and Large Reconstruction Modelcited by 378
  7. 2021ABO: Dataset and Benchmarks for Real-World 3D Object Understandingcited by 366
  8. 20203D-FUTURE: 3D Furniture shape with TextUREcited by 311
  9. 2023RealFusion: 360deg Reconstruction of Any Object from a Single Imagecited by 306
  10. 2024GRM: Large Gaussian Reconstruction Model for Efficient 3D Reconstruction and Generationcited by 301
  11. 2023LucidDreamer: Domain-free Generation of 3D Gaussian Splatting Scenescited by 231
  12. 2023Habitat Synthetic Scenes Dataset (HSSD-200): An Analysis of 3D Scene Scale and Realism Tradeoffs for ObjectGoal Navigationcited by 167
  13. 2025Hunyuan3D 2.1: From Images to High-Fidelity 3D Assets with Production-Ready PBR Materialcited by 165
  14. 2023DreamEditor: Text-Driven 3D Scene Editing with Neural Fieldscited by 155
  15. 2022Dream3D: Zero-Shot Text-to-3D Synthesis Using 3D Shape Prior and Text-to-Image Diffusion Modelscited by 151
  16. 2024CraftsMan3D: High-fidelity Mesh Generation with 3D Native Generation and Interactive Geometry Refinercited by 123
  17. 2023Delta Denoising Scorecited by 121
  18. 2023Vox-E: Text-guided Voxel Editing of 3D Objectscited by 115
  19. 2024MeshXL: Neural Coordinate Field for Generative 3D Foundation Modelscited by 103
  20. 2025Step1X-3D: Towards High-Fidelity and Controllable Generation of Textured 3D Assetscited by 87
  21. 2024TIP-Editor: An Accurate 3D Editor Following Both Text-Prompts And Image-Promptscited by 77
  22. 2023FocalDreamer: Text-driven 3D Editing via Focal-fusion Assemblycited by 76
  23. 2024Generic 3D Diffusion Adapter Using Controlled Multi-View Editingcited by 47
  24. 2025VoxHammer: Training-Free Precise and Coherent 3D Editing in Native 3D Spacecited by 45
  25. 2024Instant3dit: Multiview Inpainting for Fast Editing of 3D Objectscited by 44
  26. 2025ShapeLLM-Omni: A Native Multimodal LLM for 3D Generation and Understandingcited by 38
  27. 2023SHAP-EDITOR: Instruction-guided Latent 3D Editing in Secondscited by 37
  28. 2024Tailor3D: Customized 3D Assets Editing and Generation with Dual-Side Imagescited by 35
  29. 2024PrEditor3D: Fast and Precise 3D Shape Editingcited by 28
  30. 2025EditP23: 3D Editing via Propagation of Image Prompts to Multi-Viewcited by 20
  31. 2025MeshLLM: Empowering Large Language Models to Progressively Understand and Generate 3D Meshcited by 20
  32. 2024Chat-Edit-3D: Interactive 3D Scene Editing via Text Promptscited by 19
  33. 2023Inpaint3D: 3D Scene Content Generation using 2D Inpainting Diffusioncited by 13

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 4.

4 papers.