Learning Hierarchical and Geometry-Aware Graph Representations for Text-to-CAD
Not on the map. Why?
Abstract (arXiv)
Text-to-CAD code generation is a long-horizon task that translates textual instructions into long sequences of interdependent operations. Existing methods typically decode text directly into executable code (e.g., bpy) without explicitly modeling assembly hierarchy or geometric constraints, which enlarges the search space, accumulates local errors, and often causes cascading failures in complex assemblies. To address this issue, we propose a hierarchical and geometry-aware graph as an intermediate representation. The graph models multi-level parts and components as nodes and encodes explicit geometric constraints as edges. Instead of mapping text directly to code, our framework first predicts structure and constraints, then conditions action sequencing and code generation, thereby improving geometric fidelity and constraint satisfaction. We further introduce a structure-aware progressive curriculum learning strategy that constructs graded tasks through controlled structural edits, explores the model's capability boundary, and synthesizes boundary examples for iterative training. In addition, we build a 12K dataset with instructions, decomposition graphs, action sequences, and bpy code, together with graph- and constraint-oriented evaluation metrics. Extensive experiments show that our method consistently outperforms existing approaches in both geometric fidelity and accurate satisfaction of geometric constraints.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 42 of its 58 references that are in the map. First posted on arXiv 11 Apr 2026.
Builds on
42 of 58 references.
References · 42
- 2024The Llama 3 Herd of Modelscited by 14,192
- 2015Distilling the Knowledge in a Neural Networkcited by 10,076
- 2025Qwen3 Technical Reportcited by 8,195
- 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,767
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
- 2022Fast Inference from Transformers via Speculative Decodingcited by 1,615
- 2024LlamaFactory: Unified Efficient Fine-Tuning of 100+ Language Modelscited by 1,442
- 2020Gradient Surgery for Multi-Task Learningcited by 1,210
- 2024Medusa: Simple LLM Inference Acceleration Framework with Multiple Decoding Headscited by 821
- 2021Conflict-Averse Gradient Descent for Multi-task Learningcited by 441
- 2018Data-Efficient Hierarchical Reinforcement Learningcited by 436
- 2020Curriculum Learning for Reinforcement Learning Domains: A Framework and Surveycited by 350
30 more
- 2018Blockwise Parallel Decoding for Deep Autoregressive Modelscited by 318
- 2021DeepCAD: A Deep Generative Network for Computer-Aided Design Modelscited by 266
- 2021Curriculum Learning: A Surveycited by 257
- 2023TextDiffuser: Diffusion Models as Text Painterscited by 223
- 2016DeepCoder: Learning to Write Programscited by 145
- 2020Automatic Curriculum Learning For Deep RL: A Short Surveycited by 141
- 2018Leveraging Grammar and Reinforcement Learning for Neural Program Synthesiscited by 83
- 2024CAD-SIGNet: CAD Language Inference from Point Clouds using Layer-wise Sketch Instance Guided Attentioncited by 62
- 2024Generating CAD Code with Vision-Language Models for 3D Designscited by 61
- 2018Generative Code Modeling with Graphscited by 59
- 2025CAD-Coder: Text-to-CAD Generation with Chain-of-Thought and Geometric Rewardcited by 53
- 2024CAD-GPT: Synthesising CAD Construction Sequence with Spatial Reasoning-Enhanced Multimodal LLMscited by 52
- 2025Text-to-CAD Generation Through Infusing Visual Feedback in Large Language Modelscited by 43
- 2025Text-to-CadQuery: A New Paradigm for CAD Generation with Scalable Large Model Capabilitiescited by 43
- 2024Curriculum Direct Preference Optimization for Diffusion and Consistency Modelscited by 36
- 2023Disentangling Writer and Character Styles for Handwriting Generationcited by 35
- 2024FlexCAD: Unified and Versatile Controllable CAD Generation with Fine-tuned Large Language Modelscited by 33
- 2025CADCrafter: Generating Computer-Aided Design Models from Unconstrained Imagescited by 31
- 2024Query2CAD: Generating CAD models using natural language queriescited by 28
- 2024Denoising Task Difficulty-based Curriculum for Training Diffusion Modelscited by 26
- 2024BlenderLLM: Training Large Language Models for Computer-Aided Design with Self-improvementcited by 26
- 2024One-Shot Diffusion Mimicker for Handwritten Text Generationcited by 20
- 2023Sketch-A-Shape: Zero-Shot Sketch-to-3D Shape Generationcited by 14
- 2024KMTalk: Speech-Driven 3D Facial Animation with Key Motion Embeddingcited by 14
- 2025MPDrive: Improving Spatial Understanding with Marker-Based Prompt Learning for Autonomous Drivingcited by 12
- 2025Monocular and Generalizable Gaussian Talking Head Animationcited by 10
- 2025Beyond Isolated Words: Diffusion Brush for Handwritten Text-Line Generationcited by 10
- 2025Automated CAD Modeling Sequence Generation from Text Descriptions via Transformer-Based Large Language Modelscited by 8
- 2022Material Prediction for Design Automation Using Graph Representation Learningcited by 3
- 2024A Unified Framework of Multi-Stage Multi-Winner Voting: An Axiomatic Explorationcited by 1
Built on by
Not cited yet.