ForgeDreamer: Industrial Text-to-3D Generation with Multi-Expert LoRA and Cross-View Hypergraph
On the map: LLM reasoning → Spatial and embodied reasoning
Abstract (arXiv)
Current text-to-3D generation methods excel in natural scenes but struggle with industrial applications due to two critical limitations: domain adaptation challenges where conventional LoRA fusion causes knowledge interference across categories, and geometric reasoning deficiencies where pairwise consistency constraints fail to capture higher-order structural dependencies essential for precision manufacturing. We propose a novel framework named ForgeDreamer addressing both challenges through two key innovations. First, we introduce a Multi-Expert LoRA Ensemble mechanism that consolidates multiple category-specific LoRA models into a unified representation, achieving superior cross-category generalization while eliminating knowledge interference. Second, building on enhanced semantic understanding, we develop a Cross-View Hypergraph Geometric Enhancement approach that captures structural dependencies spanning multiple viewpoints simultaneously. These components work synergistically improved semantic understanding, enables more effective geometric reasoning, while hypergraph modeling ensures manufacturing-level consistency. Extensive experiments on a custom industrial dataset demonstrate superior semantic generalization and enhanced geometric fidelity compared to state-of-the-art approaches. Code is available at https://github.com/Junhaocai27/ForgeDreamer
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Spatial and embodied reasoning, one of 17 directions in LLM reasoning. Builds on 44 of its 57 references that are in the map. First posted on arXiv 10 Mar 2026.
Builds on
44 of 57 references.
References · 44
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2020Denoising Diffusion Implicit Modelscited by 9,655
- 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,539
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
- 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,698
- 2023QLoRA: Efficient Finetuning of Quantized LLMscited by 3,355
- 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,006
- 2020pixelNeRF: Neural Radiance Fields from One or Few Imagescited by 1,574
- 2023Zero-1-to-3: Zero-shot One Image to 3D Objectcited by 1,483
- 2022Magic3D: High-Resolution Text-to-3D Content Creationcited by 1,285
32 more
- 2023ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillationcited by 1,207
- 2022Multi-Concept Customization of Text-to-Image Diffusioncited by 1,099
- 2023MVDream: Multi-view Diffusion for 3D Generationcited by 928
- 2023LRM: Large Reconstruction Model for Single Image to 3Dcited by 834
- 2020GIRAFFE: Representing Scenes as Compositional Generative Neural Feature Fieldscited by 784
- 2021Diffusion Probabilistic Models for 3D Point Cloud Generationcited by 734
- 2021IBRNet: Learning Multi-View Image-Based Renderingcited by 698
- 2022Point-E: A System for Generating 3D Point Clouds from Complex Promptscited by 694
- 2020GRAF: Generative Radiance Fields for 3D-Aware Image Synthesiscited by 688
- 2023Fantasia3D: Disentangling Geometry and Appearance for High-quality Text-to-3D Content Creationcited by 684
- 2018AtlasNet: A Papier-Mach'e Approach to Learning 3D Surface Generationcited by 539
- 20213D Shape Generation and Completion through Point-Voxel Diffusioncited by 516
- 2022Latent-NeRF for Shape-Guided Generation of 3D Shapes and Texturescited by 506
- 2018Hypergraph Neural Networkscited by 482
- 2023LucidDreamer: Towards High-Fidelity Text-to-3D Generation via Interval Score Matchingcited by 290
- 2023DreamBooth3D: Subject-Driven Text-to-3D Generationcited by 235
- 2021The MVTec 3D-AD Dataset for Unsupervised 3D Anomaly Detection and Localizationcited by 174
- 2023RichDreamer: A Generalizable Normal-Depth Diffusion Model for Detail Richness in Text-to-3Dcited by 168
- 2024Real-IAD: A Real-World Multi-View Dataset for Benchmarking Versatile Industrial Anomaly Detectioncited by 138
- 2024Recent Advances in 3D Gaussian Splattingcited by 130
- 2021Learning to Efficiently Sample from Diffusion Probabilistic Modelscited by 129
- 2024Era3D: High-Resolution Multiview Diffusion using Efficient Row-wise Attentioncited by 99
- 2021BRepNet: A topological message passing system for solid modelscited by 92
- 2024Multi-LoRA Composition for Image Generationcited by 80
- 2021JoinABLe: Learning Bottom-up Assembly of Parametric CAD Jointscited by 77
- 2024Consistent3D: Towards Consistent High-Fidelity Text-to-3D Generation with Deterministic Sampling Priorcited by 60
- 2023T3Bench: Benchmarking Current Progress in Text-to-3D Generationcited by 56
- 2023DreamControl: Control-Based Text-to-3D Generation with 3D Self-Priorcited by 39
- 2024Hyper-YOLO: When Visual Object Detection Meets Hypergraph Computationcited by 29
- 2024Hyper-3DG: Text-to-3D Gaussian Generation via Hypergraphcited by 21
- 2023DreamPropeller: Supercharge Text-to-3D Generation with Parallel Samplingcited by 20
- 2023PI3D: Efficient Text-to-3D Generation with Pseudo-Image Diffusioncited by 20
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026STEP-LLM: Generating CAD STEP Models from Natural Language with Large Language Models
- 2026MUSE: Benchmarking Manufacturable, Functional, and Assemblable Text-to-CAD Generation
- 2026FORGE: Fine-grained Multimodal Evaluation for Manufacturing Scenarios
- 2026Foundation Models for Automatic CAD Generation
- 2026ELSA3D: Elastic Semantic Anchoring for Unified 3D Understanding and Generation
- 2026P3D-Bench: Benchmarking MLLMs for Parametric 3D Generation and Structural Reasoning
- 2026Semantic Enrichment of CAD-Based Industrial Environments via Scene Graphs for Simulation and Reasoning
- 2026SldprtNet: A Large-Scale Multimodal Dataset for CAD Generation in Language-Driven 3D Design