mlsanityData to 7 Oct 2026

Vinedresser3D: Agentic Text-guided 3D Editing

arXiv 2602.19542 ↗First posted 23 Feb 2026cs.CVcited by 3

On the map: LLM agents and tool use → Multimodal and embodied agents

Abstract (arXiv)

Text-guided 3D editing aims to modify existing 3D assets using natural-language instructions. Current methods struggle to jointly understand complex prompts, automatically localize edits in 3D, and preserve unedited content. We introduce Vinedresser3D, an agentic framework for high-quality text-guided 3D editing that operates directly in the latent space of a native 3D generative model. Given a 3D asset and an editing prompt, Vinedresser3D uses a multimodal large language model to infer rich descriptions of the original asset, identify the edit region and edit type (addition, modification, deletion), and generate decomposed structural and appearance-level text guidance. The agent then selects an informative view and applies an image editing model to obtain visual guidance. Finally, an inversion-based rectified-flow inpainting pipeline with an interleaved sampling module performs editing in the 3D latent space, enforcing prompt alignment while maintaining 3D coherence and unedited regions. Experiments on diverse 3D edits demonstrate that Vinedresser3D outperforms prior baselines in both automatic metrics and human preference studies, while enabling precise, coherent, and mask-free 3D editing.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Placed in Multimodal and embodied agents, one of 16 directions in LLM agents and tool use. Builds on 59 of its 67 references that are in the map. First posted on arXiv 23 Feb 2026.

Builds on

59 of 67 references.

Closest ancestors · 1

Same direction, newest first

  1. 2024SceneCraft: An LLM Agent for Synthesizing 3D Scene as Blender Code2 Mar

Other references · 58

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  3. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
  4. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
  5. 2022Classifier-Free Diffusion Guidancecited by 5,717
  6. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
  7. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,550
  8. 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,317
  9. 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,006
  10. 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,409
  11. 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,903
  12. 2023Self-RAG: Learning to Retrieve, Generate, and Critique through Self-Reflectioncited by 1,800
38 more
  1. 2022RePaint: Inpainting using Denoising Diffusion Probabilistic Modelscited by 1,419
  2. 2022Null-text Inversion for Editing Real Images using Guided Diffusion Modelscited by 1,168
  3. 2016A Point Set Generation Network for 3D Object Reconstruction from a Single Imagecited by 972
  4. 2022Plug-and-Play Diffusion Features for Text-Driven Image-to-Image Translationcited by 897
  5. 2024Structured 3D Latents for Scalable and Versatile 3D Generationcited by 742
  6. 2021DiffusionCLIP: Text-Guided Diffusion Models for Robust Image Manipulationcited by 640
  7. 2022Google Scanned Objects: A High-Quality Dataset of 3D Scanned Household Itemscited by 601
  8. 2023LayoutGPT: Compositional Visual Planning and Generation with Large Language Modelscited by 337
  9. 2025TripoSG: High-Fidelity 3D Shape Synthesis using Large-Scale Rectified Flow Modelscited by 204
  10. 2024Taming Rectified Flow for Inversion and Editingcited by 200
  11. 2023Negative-prompt Inversion: Fast Image Inversion for Editing with Text-guided Diffusion Modelscited by 172
  12. 2023GaussianEditor: Editing 3D Gaussians Delicately with Text Instructionscited by 166
  13. 2024Semantic Image Inversion and Editing using Rectified Stochastic Differential Equationscited by 162
  14. 2024Assisting in Writing Wikipedia-like Articles From Scratch with Large Language Modelscited by 150
  15. 2025CollabLLM: From Passive Responders to Active Collaboratorscited by 117
  16. 2023Vox-E: Text-guided Voxel Editing of 3D Objectscited by 114
  17. 2025CAST: Component-Aligned 3D Scene Reconstruction from an RGB Imagecited by 101
  18. 2024SAMPart3D: Segment Any Part in 3D Objectscited by 95
  19. 20233D-GPT: Procedural 3D Modeling with Large Language Modelscited by 91
  20. 2025PARTFIELD: Learning 3D Feature Fields for Part Segmentation and Beyondcited by 91
  21. 2024TIP-Editor: An Accurate 3D Editor Following Both Text-Prompts And Image-Promptscited by 76
  22. 2023FocalDreamer: Text-driven 3D Editing via Focal-fusion Assemblycited by 75
  23. 2024AvaTaR: Optimizing LLM Agents for Tool Usage via Contrastive Reasoningcited by 69
  24. 2024View-Consistent 3D Editing with Gaussian Splattingcited by 67
  25. 2023SceneWiz3D: Towards Text-guided 3D Scene Compositioncited by 54
  26. 2024Generic 3D Diffusion Adapter Using Controlled Multi-View Editingcited by 46
  27. 2024SceneTeller: Language-to-3D Scene Generationcited by 43
  28. 2024Instant3dit: Multiview Inpainting for Fast Editing of 3D Objectscited by 43
  29. 2024When LLMs step into the 3D World: A Survey and Meta-Analysis of 3D Tasks via Multi-modal Large Language Modelscited by 41
  30. 2025VoxHammer: Training-Free Precise and Coherent 3D Editing in Native 3D Spacecited by 40
  31. 2023ShapeGPT: 3D Shape Generation with A Unified Multi-modal Language Modelcited by 38
  32. 2023SHAP-EDITOR: Instruction-guided Latent 3D Editing in Secondscited by 36
  33. 2024GSEdit: Efficient Text-Guided Editing of 3D Objects via Gaussian Splattingcited by 36
  34. 20233D Paintbrush: Local Stylization of 3D Shapes with Cascaded Score Distillationcited by 34
  35. 2024Tailor3D: Customized 3D Assets Editing and Generation with Dual-Side Imagescited by 34
  36. 2025ShapeLLM-Omni: A Native Multimodal LLM for 3D Generation and Understandingcited by 34
  37. 2024PrEditor3D: Fast and Precise 3D Shape Editingcited by 27
  38. 2025ArtiScene: Language-Driven Artistic 3D Scene Generation Through Image Intermediarycited by 27

50 most cited of 58 All 58 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 3.

3 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026DesignAgent3D: Interactive 3D Scene Editing via Designer-like Multimodal Reasoning
  2. 20253D-LATTE: Latent Space 3D Editing from Textual Instructions
  3. 2026DreamEdit3D: Personalization of Multi-View Diffusion Models for 3D Editing
  4. 2023Progressive3D: Progressively Local Editing for Text-to-3D Content Creation with Complex Semantic Prompts
  5. 2026ViSculpt: Visual-Centric Agentic Geometry Editing
  6. 2026EditRefiner: A Human-Aligned Agentic Framework for Image Editing Refinement
  7. 2026EditFlow3D: Automated Local Editing of 3D Assets with Trajectory Preservation
  8. 2026MUSE: Agentic 3D Scene Authoring via Memory-Grounded Incremental Requirement Satisfaction