GetMesh: A Controllable Model for High-quality Mesh Generation and Manipulation
Not on the map. Why?
Abstract (arXiv)
Mesh is a fundamental representation of 3D assets in various industrial applications, and is widely supported by professional softwares. However, due to its irregular structure, mesh creation and manipulation is often time-consuming and labor-intensive. In this paper, we propose a highly controllable generative model, GetMesh, for mesh generation and manipulation across different categories. By taking a varying number of points as the latent representation, and re-organizing them as triplane representation, GetMesh generates meshes with rich and sharp details, outperforming both single-category and multi-category counterparts. Moreover, it also enables fine-grained control over the generation process that previous mesh generative models cannot achieve, where changing global/local mesh topologies, adding/removing mesh parts, and combining mesh parts across categories can be intuitively, efficiently, and robustly accomplished by adjusting the number, positions or features of latent points. Project page is https://getmesh.github.io.
Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Builds on 44 of its 49 references that are in the map. First posted on arXiv 18 Mar 2024.
Builds on
44 of 49 references.
References · 44
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2020Denoising Diffusion Implicit Modelscited by 9,781
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
- 2022Classifier-Free Diffusion Guidancecited by 5,847
- 2017PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Spacecited by 4,401
- 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,761
- 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,025
- 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,897
- 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,689
- 2018Occupancy Networks: Learning 3D Reconstruction in Function Spacecited by 2,041
- 2022Objaverse: A Universe of Annotated 3D Objectscited by 1,540
32 more
- 2020DiffWave: A Versatile Diffusion Model for Audio Synthesiscited by 1,354
- 2022Magic3D: High-Resolution Text-to-3D Content Creationcited by 1,290
- 2023ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillationcited by 1,219
- 2021Cascaded Diffusion Models for High Fidelity Image Generationcited by 1,163
- 2021Diffusion Probabilistic Models for 3D Point Cloud Generationcited by 735
- 2022Point-E: A System for Generating 3D Point Clouds from Complex Promptscited by 699
- 2023Fantasia3D: Disentangling Geometry and Appearance for High-quality Text-to-3D Content Creationcited by 687
- 2021Score-based Generative Modeling in Latent Spacecited by 636
- 2022LION: Latent Point Diffusion Models for 3D Shape Generationcited by 553
- 20213D Shape Generation and Completion through Point-Voxel Diffusioncited by 516
- 2019PointFlow: 3D Point Cloud Generation with Continuous Normalizing Flowscited by 488
- 2021Deep Marching Tetrahedra: a Hybrid Representation for High-Resolution 3D Shape Synthesiscited by 460
- 2022Masked Autoencoders for Point Cloud Self-supervised Learningcited by 459
- 20233DShape2VecSet: A 3D Shape Representation for Neural Fields and Generative Diffusion Modelscited by 458
- 2021Grad-TTS: A Diffusion Probabilistic Model for Text-to-Speechcited by 447
- 2022GET3D: A Generative Model of High Quality 3D Textured Shapes Learned from Imagescited by 446
- 2022Rodin: A Generative Model for Sculpting 3D Digital Avatars Using Diffusioncited by 309
- 20223D Neural Field Generation using Triplane Diffusioncited by 274
- 2023Generative Diffusion Prior for Unified Image Restoration and Enhancementcited by 199
- 2021Shape As Points: A Differentiable Poisson Solvercited by 187
- 20233DGen: Triplane Latent Diffusion for Textured Mesh Generationcited by 183
- 2021Diff-TTS: A Denoising Diffusion Model for Text-to-Speechcited by 157
- 2022Dream3D: Zero-Shot Text-to-3D Synthesis Using 3D Shape Prior and Text-to-Image Diffusion Modelscited by 151
- 2022Diffusion-SDF: Conditional Generative Modeling of Signed Distance Functionscited by 133
- 2023Locally Attentional SDF Diffusion for Controllable 3D Shape Generationcited by 130
- 2022Diffusion-SDF: Text-to-Shape via Voxelized Diffusioncited by 128
- 2021A Conditional Point Diffusion-Refinement Paradigm for 3D Point Cloud Completioncited by 100
- 20223DILG: Irregular Latent Grids for 3D Generative Modelingcited by 93
- 2022SDF-StyleGAN: Implicit SDF-Based StyleGAN for 3D Shape Generationcited by 92
- 20223D-LDM: Neural Implicit 3D Shape Generation with Latent Diffusion Modelscited by 67
- 2023Controllable Mesh Generation Through Sparse Latent Point Diffusion Modelscited by 41
- 2023MATLABER: Material-Aware Text-to-3D via LAtent BRDF auto-EncodeRcited by 30
Built on by
Citing papers per year: 2024: 3; 2025: 4; 2026: 1.
8 papers.
- 2024InstantMesh: Efficient 3D Mesh Generation from a Single Image with Sparse-view Large Reconstruction Modelscited by 433
- 2024Direct3D: Scalable Image-to-3D Generation via 3D Latent Diffusion Transformercited by 210
- 2024GaussianAnything: Interactive Point Cloud Flow Matching For 3D Object Generationcited by 12
- 2025LAMP: Data-Efficient Linear Affine Weight-Space Models for Parameter-Controlled 3D Shape Generation and Extrapolationcited by 4
- 2026OmniLiDAR: A Unified Diffusion Framework for Multi-Domain 3D LiDAR Generationcited by 2
- 2025MamTiff-CAD: Multi-Scale Latent Diffusion with Mamba+ for Complex Parametric Sequencecited by 1
- 2025QEMesh: Employing A Quadric Error Metrics-Based Representation for Mesh Generationcited by 0
- 2025ReconMOST: Multi-Layer Sea Temperature Reconstruction with Observations-Guided Diffusioncited by 0
- 2026OmniLiDAR: A Unified Diffusion Framework for Multi-Domain 3D LiDAR Generation13 May 2026
- 2025MamTiff-CAD: Multi-Scale Latent Diffusion with Mamba+ for Complex Parametric Sequence20 Nov 2025
- 2025LAMP: Data-Efficient Linear Affine Weight-Space Models for Parameter-Controlled 3D Shape Generation and Extrapolation26 Oct 2025
- 2025ReconMOST: Multi-Layer Sea Temperature Reconstruction with Observations-Guided Diffusion12 Jun 2025
- 2025QEMesh: Employing A Quadric Error Metrics-Based Representation for Mesh Generation8 Apr 2025
- 2024GaussianAnything: Interactive Point Cloud Flow Matching For 3D Object Generation12 Nov 2024
- 2024Direct3D: Scalable Image-to-3D Generation via 3D Latent Diffusion Transformer23 May 2024
- 2024InstantMesh: Efficient 3D Mesh Generation from a Single Image with Sparse-view Large Reconstruction Models10 Apr 2024