PolyGen: An Autoregressive Generative Model of 3D Meshes
Not on the map. Why?
Cited by 41 in Diffusion models, but placed by its own abstract, which didn’t fit.
Abstract (arXiv)
Polygon meshes are an efficient representation of 3D geometry, and are of central importance in computer graphics, robotics and games development. Existing learning-based approaches have avoided the challenges of working with 3D meshes, instead using alternative object representations that are more compatible with neural architectures and training approaches. We present an approach which models the mesh directly, predicting mesh vertices and faces sequentially using a Transformer-based architecture. Our model can condition on a range of inputs, including object classes, voxels, and images, and because the model is probabilistic it can produce samples that capture uncertainty in ambiguous scenarios. We show that the model is capable of producing high-quality, usable meshes, and establish log-likelihood benchmarks for the mesh-modelling task. We also evaluate the conditional models on surface reconstruction metrics against alternative methods, and demonstrate competitive performance despite not training directly on this task.
Key facts. Cited by 267 papers in the map (data through 7 Oct 2026). First posted on arXiv 23 Feb 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 24; 2022: 35; 2023: 45; 2024: 60; 2025: 48; 2026: 55.
267 papers.
Sort:
By area:
- 2024Structured 3D Latents for Scalable and Versatile 3D Generationcited by 742
- 2023One-2-3-45: Any Single Image to 3D Mesh in 45 Seconds without Per-Shape Optimizationcited by 555
- 2022LION: Latent Point Diffusion Models for 3D Shape Generationcited by 552
- 2021Deep Marching Tetrahedra: a Hybrid Representation for High-Resolution 3D Shape Synthesiscited by 459
- 20233DShape2VecSet: A 3D Shape Representation for Neural Fields and Generative Diffusion Modelscited by 449
- 2022GET3D: A Generative Model of High Quality 3D Textured Shapes Learned from Imagescited by 446
- 2024CLAY: A Controllable Large-scale Generative Model for Creating High-quality 3D Assetscited by 444
- 2023OmniObject3D: Large-Vocabulary 3D Object Dataset for Realistic Perception, Reconstruction and Generationcited by 324
- 2023One-2-3-45++: Fast Single Image to 3D Objects with Consistent Multi-View Generation and 3D Diffusioncited by 283
- 2021DeepCAD: A Deep Generative Network for Computer-Aided Design Modelscited by 266
- 2021CLIP-Forge: Towards Zero-Shot Text-to-Shape Generationcited by 254
- 2023MeshGPT: Generating Triangle Meshes with Decoder-Only Transformerscited by 254
38 more
- 2022VectorMapNet: End-to-end Vectorized HD Map Learningcited by 243
- 2023Text2Tex: Text-driven Texture Synthesis via Diffusion Modelscited by 234
- 2023MeshDiffusion: Score-based Generative 3D Mesh Modelingcited by 198
- 2021ATISS: Autoregressive Transformers for Indoor Scene Synthesiscited by 195
- 2023XCube: Large-Scale 3D Generative Modeling using Sparse Voxel Hierarchiescited by 183
- 2025Native and Compact Structured Latents for 3D Generationcited by 157
- 2023MotionLM: Multi-Agent Motion Forecasting as Language Modelingcited by 154
- 2022Dream3D: Zero-Shot Text-to-3D Synthesis Using 3D Shape Prior and Text-to-Image Diffusion Modelscited by 151
- 2024MeshAnything: Artist-Created Mesh Generation with Autoregressive Transformerscited by 140
- 2023Flexible Isosurface Extraction for Gradient-Based Mesh Optimizationcited by 138
- 2022D2NeRF: Self-Supervised Decoupling of Dynamic and Static Objects from a Monocular Videocited by 136
- 2023Let 2D Diffusion Model Know 3D-Consistency for Robust Text-to-3D Generationcited by 133
- 2024Recent Advances in 3D Gaussian Splattingcited by 130
- 2023Locally Attentional SDF Diffusion for Controllable 3D Shape Generationcited by 129
- 2022Diffusion-SDF: Text-to-Shape via Voxelized Diffusioncited by 128
- 2022SkexGen: Autoregressive Generation of CAD Construction Sequences with Disentangled Codebookscited by 121
- 2024CraftsMan3D: High-fidelity Mesh Generation with 3D Native Generation and Interactive Geometry Refinercited by 120
- 2022ShapeFormer: Transformer-based Shape Completion via Sparse Representationcited by 106
- 2024MeshAnything V2: Artist-Created Mesh Generation With Adjacent Mesh Tokenizationcited by 102
- 2024BrepGen: A B-rep Generative Diffusion Model with Structured Latent Geometrycited by 101
- 2024MeshXL: Neural Coordinate Field for Generative 3D Foundation Modelscited by 100
- 2024SceneScript: Reconstructing Scenes With An Autoregressive Structured Language Modelcited by 95
- 2021ShaRF: Shape-conditioned Radiance Fields from a Single Viewcited by 92
- 20223DILG: Irregular Latent Grids for 3D Generative Modelingcited by 92
- 2022SDF-StyleGAN: Implicit SDF-Based StyleGAN for 3D Shape Generationcited by 92
- 2022POCO: Point Convolution for Surface Reconstructioncited by 91
- 2023TexFusion: Synthesizing 3D Textures with Text-Guided Image Diffusion Modelscited by 86
- 2021SceneGen: Learning to Generate Realistic Traffic Scenescited by 83
- 2021Computer-Aided Design as Languagecited by 82
- 2022SolidGen: An Autoregressive Model for Direct B-rep Synthesiscited by 78
- 2025SparseFlex: High-Resolution and Arbitrary-Topology 3D Shape Modelingcited by 76
- 2024CAD-MLLM: Unifying Multimodality-Conditioned CAD Generation With MLLMcited by 74
- 2024Scaling Mesh Generation via Compressive Tokenizationcited by 71
- 2021SketchGen: Generating Constrained CAD Sketchescited by 68
- 2022ALSO: Automotive Lidar Self-supervision by Occupancy estimationcited by 68
- 2021Vitruvion: A Generative Model of Parametric CAD Sketchescited by 66
- 2023SALAD: Part-Level Latent Diffusion for 3D Shape Generation and Manipulationcited by 66
- 2023PolyDiff: Generating 3D Polygonal Meshes with Diffusion Modelscited by 66
50 most cited of 267 All 267 (JSON)
- 2026MeshCarve: Artisan Mesh Generation with Flow Matching in Compact Latent Spaces7 Oct 2026
- 2026OptimusMesh: Compact Autoregressive Mesh Generation from Point Clouds via Sparse Latent Pivots1 Oct 2026
- 2026MeshOctave: Vertex Split-and-Rewire Cascades for Native Mesh Generation30 Sep 2026
- 2026TaoFlowForge: Progressive Native Mesh Generation via Cascaded Flow Matching29 Sep 2026
- 2026AgentSTAR: Agentic Shape Tracking and Reconstruction from Monocular Videos21 Sep 2026
- 2026RealCAD: Towards Real-World Image-to-CAD Reconstruction under Domain Shift and Parameter Bias31 Aug 2026
- 2026AgenticCADedit: A Stateful, Tool-Mediated Agentic Approach to Multimodal 3D CAD Editing28 Aug 2026
- 2026Procedura: Agentic 3D Modeling with Procedural Control26 Aug 2026
- 2026When Should a Network Emit Geometry, and When Should It Detect It? Readout, Reconciliation, and Representation in Floorplan Vectorization26 Aug 2026
- 2026BIMScript: Material-Aware Structured Scene Programs for BIM Ingestion19 Aug 2026
- 2026P2Voxel: Pyramid Pivot Voxelization for 3D Mesh Tokenization1 Aug 2026
- 2026A Research Prototype for Closed-Loop Generative Design of Customized Foot Orthoses via Semantic-Physics Alignment18 Jul 2026
38 more
- 2026HierCAD: Hierarchical Text-to-CAD Design via Structure Alignment and Parameter Grounding13 Jul 2026
- 2026LATO.2: Factorized 3D Mesh Generation with Vertex and Topology Flow12 Jul 2026
- 2026Vitality-Aware Compression for Efficient Image-to-Shape Diffusion Transformers1 Jul 2026
- 2026Mesh BDF: Barycentric Dominance Field for 3D Native Mesh Generation30 Jun 2026
- 2026PolyFlow: Continuous Topology Embedding Flow Matching for Artist-style Mesh Generation25 Jun 2026
- 2026MeshFlow: Mesh Generation with Equivariant Flow Matching22 Jun 2026
- 2026TriFlow: Generating Artist-Like 3D Mesh Topology via Nearest-Vertex Vector Fields18 Jun 2026
- 2026GASE: Gaussian Splatting-Based Automated System for Reconstructing Embodied-Simulation Environments16 Jun 2026
- 2026GuideCAD: A Lightweight Multimodal Framework for 3D CAD Model Generation via Prefix Embedding5 Jun 2026
- 2026UniCAD: A Unified Benchmark and Universal Model for Multi-Modal Multi-Task CAD3 Jun 2026
- 2026MeshWeaver: Sparse-Voxel-Guided Surface Weaving for Autoregressive Mesh Generation3 Jun 2026
- 2026MeshFlow: Efficient Artistic Mesh Generation via MeshVAE and Flow-based Diffusion Transformer3 Jun 2026
- 2026BrickAnything: Geometry-Conditioned Buildable Brick Generation with Structure-Aware Tokenization25 May 2026
- 2026Physics-in-the-Loop: A Hybrid Agentic Architecture for Validated CAD Engineering Design19 May 2026
- 2026CompoSE: Compositional Synthesis and Editing of 3D Shapes via Part-Aware Control19 May 2026
- 2026QuadLink: Autoregressive Quad-Dominant Mesh Generation via Point-Relation Learning16 May 2026
- 2026SynVA: A Modular Toolkit for Vessel Generation and Aneurysm Editing13 May 2026
- 2026Beyond Spatial Compression: Interface-Centric Generative States for Open-World 3D Structure11 May 2026
- 2026HairGPT: Strand-as-Language Autoregressive Modeling for Realistic 3D Hairstyle Synthesis9 May 2026
- 2026MeshFIM: Local Low-Poly Mesh Editing via Fill-in-the-Middle Autoregressive Generation9 May 2026
- 2026Rollback-Free Stable Brick Structures Generation7 May 2026
- 2026SQuadGen: Generating Simple Quad Layouts via Chart Distance Fields30 Apr 2026
- 2026PhyloSDF: Phylogenetically-Conditioned Neural Generation of 3D Skull Morphology via Residual Flow Matching28 Apr 2026
- 2026Repurposing 3D Generative Model for Autoregressive Layout Generation17 Apr 2026
- 2026MeshTailor: Cutting Seams via Generative Mesh Traversal28 Mar 2026
- 2026GeoFusion-CAD: Structure-Aware Diffusion with Geometric State Space for Parametric 3D Design23 Mar 2026
- 2026LoST: Level of Semantics Tokenization for 3D Shapes18 Mar 2026
- 2026DualPrim: Compact 3D Reconstruction with Positive and Negative Primitives17 Mar 2026
- 2026SldprtNet: A Large-Scale Multimodal Dataset for CAD Generation in Language-Driven 3D Design13 Mar 2026
- 2026LATO: 3D Mesh Flow Matching with Structured TOpology Preserving LAtents6 Mar 2026
- 2026PixARMesh: Autoregressive Mesh-Native Single-View Scene Reconstruction6 Mar 2026
- 2026Pointer-CAD: Unifying B-Rep and Command Sequences via Pointer-based Edges & Faces Selection4 Mar 2026
- 2026FACE: A Face-based Autoregressive Representation for High-Fidelity and Efficient Mesh Generation2 Mar 2026
- 2026MME: Mixture of Mesh Experts with Random Walk Transformer Gating28 Feb 2026
- 2026Mesh-Pro: Asynchronous Advantage-guided Ranking Preference Optimization for Artist-style Quadrilateral Mesh Generation28 Feb 2026
- 2026BuildAnyPoint: 3D Building Structured Abstraction from Diverse Point Clouds27 Feb 2026
- 2026BoxSplitGen: A Generative Model for 3D Part Bounding Boxes in Varying Granularity24 Feb 2026
- 2026Spatial-Temporal State Propagation Autoregressive Model for 4D Object Generation21 Feb 2026
50 newest of 267 All 267 (JSON)
- 2023One-2-3-45: Any Single Image to 3D Mesh in 45 Seconds without Per-Shape Optimizationcited by 555
- 2022LION: Latent Point Diffusion Models for 3D Shape Generationcited by 552
- 20233DShape2VecSet: A 3D Shape Representation for Neural Fields and Generative Diffusion Modelscited by 449
- 2024CLAY: A Controllable Large-scale Generative Model for Creating High-quality 3D Assetscited by 444
- 2023One-2-3-45++: Fast Single Image to 3D Objects with Consistent Multi-View Generation and 3D Diffusioncited by 283
- 2023Text2Tex: Text-driven Texture Synthesis via Diffusion Modelscited by 234
- 2022Dream3D: Zero-Shot Text-to-3D Synthesis Using 3D Shape Prior and Text-to-Image Diffusion Modelscited by 151
- 2023Let 2D Diffusion Model Know 3D-Consistency for Robust Text-to-3D Generationcited by 133
- 2024CraftsMan3D: High-fidelity Mesh Generation with 3D Native Generation and Interactive Geometry Refinercited by 120
- 2024BrepGen: A B-rep Generative Diffusion Model with Structured Latent Geometrycited by 101
- 2023TexFusion: Synthesizing 3D Textures with Text-Guided Image Diffusion Modelscited by 86
- 2023SALAD: Part-Level Latent Diffusion for 3D Shape Generation and Manipulationcited by 66
12 most cited of 41 All 41 (JSON)
- 2026MeshCarve: Artisan Mesh Generation with Flow Matching in Compact Latent Spaces7 Oct 2026
- 2026TaoFlowForge: Progressive Native Mesh Generation via Cascaded Flow Matching29 Sep 2026
- 2026LATO.2: Factorized 3D Mesh Generation with Vertex and Topology Flow12 Jul 2026
- 2026Vitality-Aware Compression for Efficient Image-to-Shape Diffusion Transformers1 Jul 2026
- 2026Mesh BDF: Barycentric Dominance Field for 3D Native Mesh Generation30 Jun 2026
- 2026PolyFlow: Continuous Topology Embedding Flow Matching for Artist-style Mesh Generation25 Jun 2026
- 2026MeshFlow: Mesh Generation with Equivariant Flow Matching22 Jun 2026
- 2026MeshFlow: Efficient Artistic Mesh Generation via MeshVAE and Flow-based Diffusion Transformer3 Jun 2026
- 2026PhyloSDF: Phylogenetically-Conditioned Neural Generation of 3D Skull Morphology via Residual Flow Matching28 Apr 2026
- 2026LATO: 3D Mesh Flow Matching with Structured TOpology Preserving LAtents6 Mar 2026
- 2026BuildAnyPoint: 3D Building Structured Abstraction from Diverse Point Clouds27 Feb 2026
- 2026BoxSplitGen: A Generative Model for 3D Part Bounding Boxes in Varying Granularity24 Feb 2026
12 newest of 41 All 41 (JSON)
- 2023MotionLM: Multi-Agent Motion Forecasting as Language Modelingcited by 154
- 2026Physics-in-the-Loop: A Hybrid Agentic Architecture for Validated CAD Engineering Designcited by 3
- 2026Procedura: Agentic 3D Modeling with Procedural Controlcited by 1
- 2026AgenticCADedit: A Stateful, Tool-Mediated Agentic Approach to Multimodal 3D CAD Editingcited by 0
- 2026AgenticCADedit: A Stateful, Tool-Mediated Agentic Approach to Multimodal 3D CAD Editing28 Aug 2026
- 2026Procedura: Agentic 3D Modeling with Procedural Control26 Aug 2026
- 2026Physics-in-the-Loop: A Hybrid Agentic Architecture for Validated CAD Engineering Design19 May 2026
- 2023MotionLM: Multi-Agent Motion Forecasting as Language Modeling28 Sep 2023
- 2024Structured 3D Latents for Scalable and Versatile 3D Generationcited by 742
- 2021Deep Marching Tetrahedra: a Hybrid Representation for High-Resolution 3D Shape Synthesiscited by 459
- 2022GET3D: A Generative Model of High Quality 3D Textured Shapes Learned from Imagescited by 446
- 2023OmniObject3D: Large-Vocabulary 3D Object Dataset for Realistic Perception, Reconstruction and Generationcited by 324
- 2021DeepCAD: A Deep Generative Network for Computer-Aided Design Modelscited by 266
- 2021CLIP-Forge: Towards Zero-Shot Text-to-Shape Generationcited by 254
- 2023MeshGPT: Generating Triangle Meshes with Decoder-Only Transformerscited by 254
- 2022VectorMapNet: End-to-end Vectorized HD Map Learningcited by 243
- 2023MeshDiffusion: Score-based Generative 3D Mesh Modelingcited by 198
- 2021ATISS: Autoregressive Transformers for Indoor Scene Synthesiscited by 195
- 2023XCube: Large-Scale 3D Generative Modeling using Sparse Voxel Hierarchiescited by 183
- 2025Native and Compact Structured Latents for 3D Generationcited by 157
12 most cited of 215 All 215 (JSON)
- 2026OptimusMesh: Compact Autoregressive Mesh Generation from Point Clouds via Sparse Latent Pivots1 Oct 2026
- 2026MeshOctave: Vertex Split-and-Rewire Cascades for Native Mesh Generation30 Sep 2026
- 2026AgentSTAR: Agentic Shape Tracking and Reconstruction from Monocular Videos21 Sep 2026
- 2026RealCAD: Towards Real-World Image-to-CAD Reconstruction under Domain Shift and Parameter Bias31 Aug 2026
- 2026When Should a Network Emit Geometry, and When Should It Detect It? Readout, Reconciliation, and Representation in Floorplan Vectorization26 Aug 2026
- 2026BIMScript: Material-Aware Structured Scene Programs for BIM Ingestion19 Aug 2026
- 2026P2Voxel: Pyramid Pivot Voxelization for 3D Mesh Tokenization1 Aug 2026
- 2026A Research Prototype for Closed-Loop Generative Design of Customized Foot Orthoses via Semantic-Physics Alignment18 Jul 2026
- 2026HierCAD: Hierarchical Text-to-CAD Design via Structure Alignment and Parameter Grounding13 Jul 2026
- 2026TriFlow: Generating Artist-Like 3D Mesh Topology via Nearest-Vertex Vector Fields18 Jun 2026
- 2026GASE: Gaussian Splatting-Based Automated System for Reconstructing Embodied-Simulation Environments16 Jun 2026
- 2026GuideCAD: A Lightweight Multimodal Framework for 3D CAD Model Generation via Prefix Embedding5 Jun 2026
12 newest of 215 All 215 (JSON)