mlsanityData to 14 Oct 2026

AgenticCADedit: A Stateful, Tool-Mediated Agentic Approach to Multimodal 3D CAD Editing

arXiv 2609.29621 ↗First posted 28 Aug 2026cs.CV cs.GRcited by 0

On the map: LLM agents and tool use → Multimodal and embodied agents

Abstract (arXiv)

Computer-aided design is central to industrial manufacturing, and much of a designer's daily work consists of editing existing models from multimodal requests involving speech, sketches, and model interaction. Existing neural CAD approaches focus predominantly on unconditional or text-conditioned generation. The neuralCAD-Edit approach formalizes expert multimodal editing requests, but its iterative baseline refines a complete CAD program across attempts, executing each attempt from the original model in a stateless CAD environment. Every attempt must therefore reconstruct the entire edit from scratch, so partially correct progress is discarded rather than accumulated, and the model can neither inspect the geometry it has just produced nor selectively revert a single faulty operation. We present AgenticCADedit, which turns editing into a sequence of small, verifiable actions on a persistent CAD state instead of a single regenerated program. Rather than emitting one complete program, it applies incremental code steps that each commit to the session, inspects the resulting faces and edges, renders highlighted selections to verify that the intended region was addressed, and reverts individual operations when it was not. Subsequent actions therefore build on the geometry produced by earlier ones. Our approach improves on all metrics for all three evaluated LLMs (open-weight: qwen3.6-27b, gemma4-31b; proprietary: gpt-5.6-luna), with the largest gains for the weakest baseline model, qwen3.6-27b, whose validity rises from 51.0% to 94.8% and acceptance from 1.6% to 12.0%. A token-cost analysis with gpt-5.6-luna further shows 66.7% fewer output tokens than neuralCAD-Edit, while 94.8% of input tokens are served from the prompt cache.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Multimodal and embodied agents, one of 16 directions in LLM agents and tool use. Builds on 47 of its 64 references that are in the map. First posted on arXiv 28 Aug 2026.

Builds on

47 of 64 references.

Closest ancestors · 4

Same direction, newest first

  1. 2026Embodied CAD: Solver-Grounded LLM Agents for Parametric B-Rep Assembly Modeling30 Jun
  2. 2026Zero-to-CAD: Agentic Synthesis of Interpretable CAD Programs at Million-Scale Without Real Data27 Apr
  3. 2026CADSmith: Multi-Agent CAD Generation with Programmatic Geometric Validation27 Mar
  4. 2025BIMgent: Towards Autonomous Building Modeling via Computer-use Agents8 Jun

Other references · 43

  1. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
  2. 2024Structured 3D Latents for Scalable and Versatile 3D Generationcited by 770
  3. 2021Diffusion Probabilistic Models for 3D Point Cloud Generationcited by 735
  4. 20213D Shape Generation and Completion through Point-Voxel Diffusioncited by 516
  5. 2018ABC: A Big CAD Model Dataset For Geometric Deep Learningcited by 341
  6. 2021DeepCAD: A Deep Generative Network for Computer-Aided Design Modelscited by 271
  7. 2020PolyGen: An Autoregressive Generative Model of 3D Meshescited by 269
  8. 2025TripoSG: High-Fidelity 3D Shape Synthesis using Large-Scale Rectified Flow Modelscited by 213
  9. 2024GPT-4V(ision) is a Human-Aligned Evaluator for Text-to-3D Generationcited by 153
  10. 2022SkexGen: Autoregressive Generation of CAD Construction Sequences with Disentangled Codebookscited by 125
  11. 2024BrepGen: A B-rep Generative Diffusion Model with Structured Latent Geometrycited by 103
  12. 2021BRepNet: A topological message passing system for solid modelscited by 95
31 more
  1. 2023Hierarchical Neural Coding for Controllable CAD Model Generationcited by 86
  2. 2021Computer-Aided Design as Languagecited by 82
  3. 2024CAD-MLLM: Unifying Multimodality-Conditioned CAD Generation With MLLMcited by 81
  4. 2022SolidGen: An Autoregressive Model for Direct B-rep Synthesiscited by 80
  5. 2021JoinABLe: Learning Bottom-up Assembly of Parametric CAD Jointscited by 78
  6. 2020SketchGraphs: A Large-Scale Dataset for Modeling Relational Geometry in Computer-Aided Designcited by 72
  7. 2021SketchGen: Generating Constrained CAD Sketchescited by 68
  8. 2025CAD-Llama: Leveraging Large Language Models for Computer-Aided Design Parametric 3D Model Generationcited by 67
  9. 2024CAD-Recode: Reverse Engineering CAD Code from Point Cloudscited by 66
  10. 2024CAD-SIGNet: CAD Language Inference from Point Clouds using Layer-wise Sketch Instance Guided Attentioncited by 64
  11. 2024CAD-GPT: Synthesising CAD Construction Sequence with Spatial Reasoning-Enhanced Multimodal LLMscited by 53
  12. 2021Engineering Sketch Generation for Computer-Aided Designcited by 49
  13. 2025Text-to-CAD Generation Through Infusing Visual Feedback in Large Language Modelscited by 47
  14. 2025Text-to-CadQuery: A New Paradigm for CAD Generation with Scalable Large Model Capabilitiescited by 43
  15. 2025CAD-Coder: An Open-Source Vision-Language Model for Computer-Aided Design Code Generationcited by 43
  16. 2025CADCrafter: Generating Computer-Aided Design Models from Unconstrained Imagescited by 35
  17. 2024FlexCAD: Unified and Versatile Controllable CAD Generation with Fine-tuned Large Language Modelscited by 34
  18. 2022CADOps-Net: Jointly Learning CAD Operation Types and Steps from Boundary-Representationscited by 31
  19. 2025HoLa: B-Rep Generation using a Holistic Latent Representationcited by 30
  20. 2024TransCAD: A Hierarchical Transformer for CAD Sequence Inference from Point Cloudscited by 29
  21. 2024CadVLM: Bridging Language and Vision in the Generation of Parametric CAD Sketchescited by 28
  22. 2025CADDreamer: CAD Object Generation from Single-view Imagescited by 25
  23. 2024Text2CAD: Generating Sequential CAD Models from Beginner-to-Expert Level Text Promptscited by 23
  24. 20243D-PreMise: Can Large Language Models Generate 3D Shapes with Sharp Features and Parametric Control?cited by 21
  25. 2025CAD-Editor: A Locate-then-Infill Framework with Automated Training Data Synthesis for Text-Based CAD Editingcited by 19
  26. 2025AutoBrep: Autoregressive B-Rep Generation with Unified Topology and Geometrycited by 17
  27. 2025BrepGPT: Autoregressive B-rep Generation with Voronoi Half-Patchcited by 13
  28. 20253D-LATTE: Latent Space 3D Editing from Textual Instructionscited by 11
  29. 2025MeshPad: Interactive Sketch-Conditioned Artist-Reminiscent Mesh Generation and Editingcited by 7
  30. 2026neuralCAD-Edit: An Expert Benchmark for Multimodal-Instructed 3D CAD Model Editingcited by 3
  31. 2025MCP4IFC: IFC-Based Building Design Using Large Language Modelscited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026IterCAD: An Iterative Multimodal Agent for Visually-Grounded CAD Generation and Editing
  2. 2026PR-CAD: Progressive Refinement for Unified Controllable and Faithful Text-to-CAD Generation with Large Language Models
  3. 2026ViSculpt: Visual-Centric Agentic Geometry Editing
  4. 2026CADBench: A Multimodal Benchmark for AI-Assisted CAD Program Generation
  5. 2026DesignAgent3D: Interactive 3D Scene Editing via Designer-like Multimodal Reasoning
  6. 2026TOOLCAD: Exploring Tool-Using Large Language Models in Text-to-CAD Generation with Reinforcement Learning
  7. 2026LLM-Aided Design for Manufacturing: A Multi-Agent System for Intent-Preserving Redesign of CAD for Improved Manufacturability
  8. 2025cadrille: Multi-modal CAD Reconstruction with Reinforcement Learning