Vinedresser3D: Agentic Text-guided 3D Editing
On the map: LLM agents and tool use → Multimodal and embodied agents
Abstract (arXiv)
Text-guided 3D editing aims to modify existing 3D assets using natural-language instructions. Current methods struggle to jointly understand complex prompts, automatically localize edits in 3D, and preserve unedited content. We introduce Vinedresser3D, an agentic framework for high-quality text-guided 3D editing that operates directly in the latent space of a native 3D generative model. Given a 3D asset and an editing prompt, Vinedresser3D uses a multimodal large language model to infer rich descriptions of the original asset, identify the edit region and edit type (addition, modification, deletion), and generate decomposed structural and appearance-level text guidance. The agent then selects an informative view and applies an image editing model to obtain visual guidance. Finally, an inversion-based rectified-flow inpainting pipeline with an interleaved sampling module performs editing in the 3D latent space, enforcing prompt alignment while maintaining 3D coherence and unedited regions. Experiments on diverse 3D edits demonstrate that Vinedresser3D outperforms prior baselines in both automatic metrics and human preference studies, while enabling precise, coherent, and mask-free 3D editing.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Placed in Multimodal and embodied agents, one of 16 directions in LLM agents and tool use. Builds on 59 of its 67 references that are in the map. First posted on arXiv 23 Feb 2026.
Builds on
59 of 67 references.
Closest ancestors · 1
Same direction, newest first
Other references · 58
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
- 2022Classifier-Free Diffusion Guidancecited by 5,717
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,550
- 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,317
- 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,006
- 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,409
- 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,903
- 2023Self-RAG: Learning to Retrieve, Generate, and Critique through Self-Reflectioncited by 1,800
38 more
- 2022RePaint: Inpainting using Denoising Diffusion Probabilistic Modelscited by 1,419
- 2022Null-text Inversion for Editing Real Images using Guided Diffusion Modelscited by 1,168
- 2016A Point Set Generation Network for 3D Object Reconstruction from a Single Imagecited by 972
- 2022Plug-and-Play Diffusion Features for Text-Driven Image-to-Image Translationcited by 897
- 2024Structured 3D Latents for Scalable and Versatile 3D Generationcited by 742
- 2021DiffusionCLIP: Text-Guided Diffusion Models for Robust Image Manipulationcited by 640
- 2022Google Scanned Objects: A High-Quality Dataset of 3D Scanned Household Itemscited by 601
- 2023LayoutGPT: Compositional Visual Planning and Generation with Large Language Modelscited by 337
- 2025TripoSG: High-Fidelity 3D Shape Synthesis using Large-Scale Rectified Flow Modelscited by 204
- 2024Taming Rectified Flow for Inversion and Editingcited by 200
- 2023Negative-prompt Inversion: Fast Image Inversion for Editing with Text-guided Diffusion Modelscited by 172
- 2023GaussianEditor: Editing 3D Gaussians Delicately with Text Instructionscited by 166
- 2024Semantic Image Inversion and Editing using Rectified Stochastic Differential Equationscited by 162
- 2024Assisting in Writing Wikipedia-like Articles From Scratch with Large Language Modelscited by 150
- 2025CollabLLM: From Passive Responders to Active Collaboratorscited by 117
- 2023Vox-E: Text-guided Voxel Editing of 3D Objectscited by 114
- 2025CAST: Component-Aligned 3D Scene Reconstruction from an RGB Imagecited by 101
- 2024SAMPart3D: Segment Any Part in 3D Objectscited by 95
- 20233D-GPT: Procedural 3D Modeling with Large Language Modelscited by 91
- 2025PARTFIELD: Learning 3D Feature Fields for Part Segmentation and Beyondcited by 91
- 2024TIP-Editor: An Accurate 3D Editor Following Both Text-Prompts And Image-Promptscited by 76
- 2023FocalDreamer: Text-driven 3D Editing via Focal-fusion Assemblycited by 75
- 2024AvaTaR: Optimizing LLM Agents for Tool Usage via Contrastive Reasoningcited by 69
- 2024View-Consistent 3D Editing with Gaussian Splattingcited by 67
- 2023SceneWiz3D: Towards Text-guided 3D Scene Compositioncited by 54
- 2024Generic 3D Diffusion Adapter Using Controlled Multi-View Editingcited by 46
- 2024SceneTeller: Language-to-3D Scene Generationcited by 43
- 2024Instant3dit: Multiview Inpainting for Fast Editing of 3D Objectscited by 43
- 2024When LLMs step into the 3D World: A Survey and Meta-Analysis of 3D Tasks via Multi-modal Large Language Modelscited by 41
- 2025VoxHammer: Training-Free Precise and Coherent 3D Editing in Native 3D Spacecited by 40
- 2023ShapeGPT: 3D Shape Generation with A Unified Multi-modal Language Modelcited by 38
- 2023SHAP-EDITOR: Instruction-guided Latent 3D Editing in Secondscited by 36
- 2024GSEdit: Efficient Text-Guided Editing of 3D Objects via Gaussian Splattingcited by 36
- 20233D Paintbrush: Local Stylization of 3D Shapes with Cascaded Score Distillationcited by 34
- 2024Tailor3D: Customized 3D Assets Editing and Generation with Dual-Side Imagescited by 34
- 2025ShapeLLM-Omni: A Native Multimodal LLM for 3D Generation and Understandingcited by 34
- 2024PrEditor3D: Fast and Precise 3D Shape Editingcited by 27
- 2025ArtiScene: Language-Driven Artistic 3D Scene Generation Through Image Intermediarycited by 27
50 most cited of 58 All 58 (JSON)
Built on by
Citing papers per year: 2026: 3.
3 papers.
- 2026Agentic Visual Generation: From Generative Models to Agentic Control6 Sep 2026
- 2026VibeWorlding: Can Multimodal Agents Construct 3D Open Worlds End-to-End?15 Aug 2026
- 2026Velocity-Space 3D Asset Editing8 May 2026
Similar, not cited
Close in wording, no citation either way
- 2026DesignAgent3D: Interactive 3D Scene Editing via Designer-like Multimodal Reasoning
- 20253D-LATTE: Latent Space 3D Editing from Textual Instructions
- 2026DreamEdit3D: Personalization of Multi-View Diffusion Models for 3D Editing
- 2023Progressive3D: Progressively Local Editing for Text-to-3D Content Creation with Complex Semantic Prompts
- 2026ViSculpt: Visual-Centric Agentic Geometry Editing
- 2026EditRefiner: A Human-Aligned Agentic Framework for Image Editing Refinement
- 2026EditFlow3D: Automated Local Editing of 3D Assets with Trajectory Preservation
- 2026MUSE: Agentic 3D Scene Authoring via Memory-Grounded Incremental Requirement Satisfaction