BlenderRAG: High-Fidelity 3D Object Generation via Retrieval-Augmented Code Synthesis
On the map: Retrieval-augmented generation → RAG for code
Abstract (arXiv)
Automatic generation of executable Blender code from natural language remains challenging, with state-of-the-art LLMs producing frequent syntactic errors and geometrically inconsistent objects. We present BlenderRAG, a retrieval-augmented generation system that operates on a curated multimodal dataset of 500 expert-validated examples (text, code, image) across 50 object categories. By retrieving semantically similar examples during generation, BlenderRAG improves compilation success rates from 40.8% to 70.0% and semantic normalized alignment from 0.41 to 0.77 (CLIP similarity) across four state-of-the-art LLMs, without requiring fine-tuning or specialized hardware, making it immediately accessible for deployment. The dataset and code will be available at https://github.com/MaxRondelli/BlenderRAG.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in RAG for code, one of 15 directions in Retrieval-augmented generation. Builds on 10 of its 13 references that are in the map. First posted on arXiv 1 May 2026.
Builds on
10 of 13 references.
References · 10
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
- 2021Evaluating Large Language Models Trained on Codecited by 8,053
- 2021Program Synthesis with Large Language Modelscited by 3,509
- 2020REALM: Retrieval-Augmented Language Model Pre-Trainingcited by 2,126
- 2023Code Llama: Open Foundation Models for Codecited by 2,105
- 2021Improving language models by retrieving from trillions of tokenscited by 1,278
- 2023StarCoder: may the source be with you!cited by 790
- 20233D-GPT: Procedural 3D Modeling with Large Language Modelscited by 91
- 2024SceneCraft: Layout-Guided 3D Scene Generationcited by 40
- 2024BlenderLLM: Training Large Language Models for Computer-Aided Design with Self-improvementcited by 26
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025MeshCoder: LLM-Powered Structured Mesh Code Generation from Point Clouds
- 2025LL3M: Large Language 3D Modelers
- 20253DFroMLLM: 3D Prototype Generation only from Pretrained Multimodal LLMs
- 20263D-CoS: A New 3D Reconstruction Paradigm Based on VLM Code Synthesis
- 2024A Survey On Text-to-3D Contents Generation In The Wild
- 2026P3D-Bench: Benchmarking MLLMs for Parametric 3D Generation and Structural Reasoning
- 2026PartRAG: Retrieval-Augmented Part-Level 3D Generation and Editing
- 2024Generating CAD Code with Vision-Language Models for 3D Designs