P3D-Bench: Benchmarking MLLMs for Parametric 3D Generation and Structural Reasoning
On the map: LLM reasoning → Spatial and embodied reasoning
Abstract (arXiv)
Multimodal large language models can write code to produce complex programs as well as use programs to do 3D modeling, which opens up a new avenue for 3D generation powered by their priors, world knowledge and reasoning. Yet existing benchmarks rarely evaluate 3D modeling through code. Such modeling demands more than runnable code: from a text or visual specification, a model must generate a parametric 3D program that is geometrically precise, semantically aligned and assembly-consistent. We introduce P3D-Bench, a benchmark for parametric 3D generation. Unlike a 3D mesh, a parametric 3D program exposes explicit dimensions, construction operations and part relations, revealing whether a model recovers a design's structure, not just its appearance. Under a unified protocol, P3D-Bench covers three task families (Text-to-3D, Image-to-3D and Assembly-3D) and scores each output for executability, geometric fidelity, topology, text-grounded constraints, multiview semantic alignment and part-level structure. We evaluate frontier MLLMs and text-only LLMs on 400 text cases, 400 image cases and 203 annotated assemblies, with domain-specific models as reference points. Our extensive evaluation yields three findings. First, assemblies are the hardest setting, where models still fail to compose multiple parts into a coherent structure. Second, models can often recover the global shape and semantic identity of the target object, yet fail to reproduce the precise parametric geometry specified by the input. Third, part-level modeling remains weak on assemblies, where models recover neither the geometry of each part nor the right number of parts. These results position P3D-Bench as a benchmark for evaluating precise parametric geometry and part-level structure in parametric 3D generation.
Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Placed in Spatial and embodied reasoning, one of 17 directions in LLM reasoning. Builds on 19 of its 47 references that are in the map. First posted on arXiv 9 Jun 2026.
Builds on
19 of 47 references.
Closest ancestors · 1
Same direction, newest first
Other references · 18
- 2021Evaluating Large Language Models Trained on Codecited by 8,053
- 2022SkexGen: Autoregressive Generation of CAD Construction Sequences with Disentangled Codebookscited by 121
- 2023T3Bench: Benchmarking Current Progress in Text-to-3D Generationcited by 56
- 2025Text-to-CadQuery: A New Paradigm for CAD Generation with Scalable Large Model Capabilitiescited by 43
- 2026Vision-as-Inverse-Graphics Agent via Interleaved Multimodal Reasoningcited by 40
- 2025CAD-Coder: An Open-Source Vision-Language Model for Computer-Aided Design Code Generationcited by 39
- 2026Articraft: An Agentic System for Scalable Articulated 3D Asset Generationcited by 25
- 2025LL3M: Large Language 3D Modelerscited by 18
- 2025cadrille: Multi-modal CAD Reconstruction with Reinforcement Learningcited by 14
- 20253DGen-Bench: Comprehensive Benchmark Suite for 3D Generative Modelscited by 12
- 2026CADSmith: Multi-Agent CAD Generation with Programmatic Geometric Validationcited by 11
- 2026BenchCAD: A Comprehensive, Industry-Standard Benchmark for Programmatic CADcited by 11
6 more
- 2026Text2CAD-Bench: A Benchmark for LLM-based Text-to-Parametric CAD Generationcited by 11
- 20263DCodeBench: Benchmarking Agentic Procedural 3D Modeling Via Codecited by 9
- 2026MUSE: Benchmarking Manufacturable, Functional, and Assemblable Text-to-CAD Generationcited by 8
- 2026Clarify Before You Draw: Proactive Agents for Robust Text-to-CAD Generationcited by 7
- 2026ArtiCAD: Articulated CAD Assembly Design via Multi-Agent Code Generationcited by 7
- 2026UniCAD: A Unified Benchmark and Universal Model for Multi-Modal Multi-Task CADcited by 3
Built on by
Citing papers per year: 2026: 8.
8 papers.
- 2026WorldClaw: Agentic 3D Open-World Generation at Scalecited by 6
- 2026PairCoder++: Pair Programming as a Universal Paradigm for Verified Code-Driven Multimodal and Structured-Artifact Generationcited by 2
- 2026Agentic Game Development as a Verifiable Trajectory Data Engine for Scaling World Modelscited by 1
- 2026Procedura: Agentic 3D Modeling with Procedural Controlcited by 1
- 2026RealCADBench: Benchmarking Parametric CAD Modeling from Industrial Design Intentscited by 0
- 2026VisCAD: A Foundation Model Suite with Multimodal Industrial CAD Intelligencecited by 0
- 20263DHarnessBench: Probing Agentic 3D-to-Code Capabilities of Frontier Vision-Language Modelscited by 0
- 2026LEGO-Anything: Coding Agents for 3D Scene Reconstructioncited by 0
- 2026LEGO-Anything: Coding Agents for 3D Scene Reconstruction28 Sep 2026
- 20263DHarnessBench: Probing Agentic 3D-to-Code Capabilities of Frontier Vision-Language Models6 Sep 2026
- 2026VisCAD: A Foundation Model Suite with Multimodal Industrial CAD Intelligence3 Sep 2026
- 2026RealCADBench: Benchmarking Parametric CAD Modeling from Industrial Design Intents3 Sep 2026
- 2026Procedura: Agentic 3D Modeling with Procedural Control26 Aug 2026
- 2026Agentic Game Development as a Verifiable Trajectory Data Engine for Scaling World Models26 Aug 2026
- 2026WorldClaw: Agentic 3D Open-World Generation at Scale5 Aug 2026
- 2026PairCoder++: Pair Programming as a Universal Paradigm for Verified Code-Driven Multimodal and Structured-Artifact Generation2 Jul 2026
Similar, not cited
Close in wording, no citation either way
- 2025ShapeLib: Designing a library of programmatic 3D shape abstractions with Large Language Models
- 2025Let Language Constrain Geometry: Vision-Language Models as Semantic and Spatial Critics for 3D Generation
- 2026Foundation Models for Automatic CAD Generation
- 2026OmniMech: All-in-one Multimodal Mechanical Benchmark for 3D Reconstruction
- 20243DBench: A Scalable 3D Benchmark and Instruction-Tuning Dataset
- 2025FirePlace: Geometric Refinements of LLM Common Sense Reasoning for 3D Object Placement
- 2026ELSA3D: Elastic Semantic Anchoring for Unified 3D Understanding and Generation
- 2026How Far Are Vision-Language Models from Constructing the Real World? A Benchmark for Physical Generative Reasoning