Pixel2Mesh: Generating 3D Mesh Models from Single RGB Images
Not on the map. Why?
Cited by 43 in Diffusion models, but placed by its own abstract, which didn’t fit.
Abstract (arXiv)
We propose an end-to-end deep learning architecture that produces a 3D shape in triangular mesh from a single color image. Limited by the nature of deep neural network, previous methods usually represent a 3D shape in volume or point cloud, and it is non-trivial to convert them to the more ready-to-use mesh model. Unlike the existing methods, our network represents 3D mesh in a graph-based convolutional neural network and produces correct geometry by progressively deforming an ellipsoid, leveraging perceptual features extracted from the input image. We adopt a coarse-to-fine strategy to make the whole deformation procedure stable, and define various of mesh related losses to capture properties of different levels to guarantee visually appealing and physically accurate 3D geometry. Extensive experiments show that our method not only qualitatively produces mesh model with better details, but also achieves higher 3D shape estimation accuracy compared to the state-of-the-art.
Key facts. Cited by 651 papers in the map (data through 14 Oct 2026). First posted on arXiv 5 Apr 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 150; 2022: 152; 2023: 141; 2024: 99; 2025: 65; 2026: 44.
651 papers.
Sort:
By area:
- 2021NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstructioncited by 1,712
- 2022TensoRF: Tensorial Radiance Fieldscited by 1,280
- 2023LRM: Large Reconstruction Model for Single Image to 3Dcited by 849
- 2023Objaverse-XL: A Universe of 10M+ 3D Objectscited by 774
- 2022Point-E: A System for Generating 3D Point Clouds from Complex Promptscited by 699
- 2021Common Objects in 3D: Large-Scale Learning and Evaluation of Real-life 3D Category Reconstructioncited by 652
- 2023One-2-3-45: Any Single Image to 3D Mesh in 45 Seconds without Per-Shape Optimizationcited by 560
- 2022Point-NeRF: Point-based Neural Radiance Fieldscited by 503
- 2021Deep Marching Tetrahedra: a Hybrid Representation for High-Resolution 3D Shape Synthesiscited by 460
- 2024MonST3R: A Simple Approach for Estimating Geometry in the Presence of Motioncited by 442
- 2024InstantMesh: Efficient 3D Mesh Generation from a Single Image with Sparse-view Large Reconstruction Modelscited by 433
- 2023Magic123: One Image to High-Quality 3D Object Generation Using Both 2D and 3D Diffusion Priorscited by 397
38 more
- 2024Metric3Dv2: A Versatile Monocular Geometric Foundation Model for Zero-shot Metric Depth and Surface Normal Estimationcited by 395
- 2023Metric3D: Towards Zero-shot Metric 3D Prediction from A Single Imagecited by 365
- 2021MonoScene: Monocular 3D Semantic Scene Completioncited by 363
- 2021Neural RGB-D Surface Reconstructioncited by 313
- 2024PGSR: Planar-based Gaussian Splatting for Efficient and High-Fidelity Surface Reconstructioncited by 285
- 2023One-2-3-45++: Fast Single Image to 3D Objects with Consistent Multi-View Generation and 3D Diffusioncited by 283
- 2021DeepCAD: A Deep Generative Network for Computer-Aided Design Modelscited by 271
- 2021Mesh Graphormercited by 265
- 2023Triplane Meets Gaussian Splatting: Fast and Generalizable Single-View 3D Reconstruction with Transformerscited by 258
- 2021CLIP-Forge: Towards Zero-Shot Text-to-Shape Generationcited by 254
- 2021PyMAF: 3D Human Pose and Shape Regression with Pyramidal Mesh Alignment Feedback Loopcited by 250
- 2025SAM 3D: 3Dfy Anything in Imagescited by 247
- 2024TripoSR: Fast 3D Object Reconstruction from a Single Imagecited by 232
- 2021Self-Supervised Pretraining of 3D Features on any Point-Cloudcited by 217
- 2022AutoSDF: Shape Priors for 3D Completion, Reconstruction and Generationcited by 208
- 2023MeshDiffusion: Score-based Generative 3D Mesh Modelingcited by 199
- 2021Shape As Points: A Differentiable Poisson Solvercited by 187
- 2021CodeNeRF: Disentangled Neural Radiance Fields for Object Categoriescited by 183
- 2022SinNeRF: Training Neural Radiance Fields on Complex Scenes from a Single Imagecited by 165
- 2022PyMAF-X: Towards Well-aligned Full-body Model Regression from Monocular Imagescited by 153
- 2022NeuralLift-360: Lifting An In-the-wild 2D Photo to A 3D Object with 360deg Viewscited by 148
- 2023Flexible Isosurface Extraction for Gradient-Based Mesh Optimizationcited by 139
- 2022D2NeRF: Self-Supervised Decoupling of Dynamic and Static Objects from a Monocular Videocited by 137
- 2022Neural Wavelet-domain Diffusion for 3D Shape Generationcited by 132
- 2023Locally Attentional SDF Diffusion for Controllable 3D Shape Generationcited by 130
- 2023S-NeRF: Neural Radiance Fields for Street Viewscited by 116
- 2024MVSplat360: Feed-Forward 360 Scene Synthesis from Sparse Viewscited by 116
- 2021A-SDF: Learning Disentangled Signed Distance Functions for Articulated Shape Representationcited by 114
- 2024RadSplat: Radiance Field-Informed Gaussian Splatting for Robust Real-Time Rendering with 900+ FPScited by 113
- 2022MagicPony: Learning Articulated 3D Animals in the Wildcited by 112
- 2022ShapeFormer: Transformer-based Shape Completion via Sparse Representationcited by 106
- 2023HoloDiffusion: Training a 3D Diffusion Model using 2D Imagescited by 106
- 2021Neural Parts: Learning Expressive 3D Shape Abstractions with Invertible Neural Networkscited by 103
- 2021gradSim: Differentiable simulation for system identification and visuomotor controlcited by 100
- 2021NeuTex: Neural Texture Mapping for Volumetric Neural Renderingcited by 98
- 2022CHORE: Contact, Human and Object REconstruction from a single RGB imagecited by 95
- 2021Holistic 3D Scene Understanding from a Single Image with Implicit Representationcited by 94
- 2021ShaRF: Shape-conditioned Radiance Fields from a Single Viewcited by 92
50 most cited of 651 All 651 (JSON)
- 2026NOFACE3D: NOise-scheduled Focused Anchoring and Controlled Enhancement for 3D Generation9 Oct 2026
- 2026I2CD: Direct Image-to-Convex Decomposition for Simulation-Ready Collision Geometry2 Oct 2026
- 2026OptimusMesh: Compact Autoregressive Mesh Generation from Point Clouds via Sparse Latent Pivots1 Oct 2026
- 2026SPOON: Towards Coherent Compositional 3D Scene Generation from Uncalibrated Multi-view Images30 Sep 2026
- 2026RealCAD: Towards Real-World Image-to-CAD Reconstruction under Domain Shift and Parameter Bias31 Aug 2026
- 2026A Survey on Adversarial Attacks and Defenses for Diffusion Models Across Multiple Modalities28 Aug 2026
- 2026Reconstructing Humans and Objects in Interaction using Large Reconstruction Models27 Aug 2026
- 2026View-Adaptive Renderer for View-Consistent 2D-to-3D Generation10 Aug 2026
- 2026OmniMech: All-in-one Multimodal Mechanical Benchmark for 3D Reconstruction6 Aug 2026
- 2026Learning Manifolds in High-D Point Embedding for Anisotropic Surface Approximation from Unstructured Point Clouds30 Jul 2026
- 2026StructureGS: Structure-aware Gaussian Splatting for Articulated Object Reconstruction29 Jul 2026
- 2026Scene-SAM3D: Multi-View Scene Asset Generation Without Fine-Tuning18 Jul 2026
38 more
- 2026HeartVolMesh: Cardiac Volumetric Mesh Reconstruction via Covariance-Guided Graph Deformation5 Jul 2026
- 2026Personalized 4D Whole-Heart Mesh Reconstruction from Cine MRI via Multi-Scale Temporal Modeling and Differentiable Contour Rendering2 Jul 2026
- 2026Knowledge-Driven Dimension Estimation from a Single Image -3D Asset Generation Technology for Digital Twin Construction29 Jun 2026
- 2026Deep Learning Approaches for 3D Medical Scene Completion: From Geometric Modeling to Generative Paradigms23 Jun 2026
- 2026ExMesh: Explicit Mesh Reconstruction with Topology Adaptation5 Jun 2026
- 2026S2MDF: A Plug-And-Play Layer for Intersection-Free Multi-Object Signed Distance Fields28 May 2026
- 2026Geometry-Guided Modeling of Foundation Features Enables Generalizable Object Shape Deformation Learning28 May 2026
- 2026Category-Level 3D Correspondence in Camera Space via Morphable Object Priors27 May 2026
- 2026TriSplat: Simulation-Ready Feed-Forward 3D Scene Reconstruction25 May 2026
- 2026CineMesh4D: Personalized 4D Whole Heart Reconstruction from Sparse Cine MRI13 May 2026
- 2026CADFit: Precise Mesh-to-CAD Program Generation with Hybrid Optimization2 May 2026
- 2026Point-MF: Stabilizing One-Step Mean Flows for Single-Image Point Cloud Reconstruction27 Apr 2026
- 2026LEXIS: LatEnt ProXimal Interaction Signatures for 3D HOI from an Image22 Apr 2026
- 2026D-Prism: Differentiable Primitives for Structured Dynamic Modeling18 Apr 2026
- 2026Reconstruction of a 3D wireframe from a single line drawing via generative depth estimation15 Apr 2026
- 2026Deformation-based In-Context Learning for Point Cloud Understanding3 Apr 2026
- 2026Shape Representation using Gaussian Process mixture models1 Apr 2026
- 2026textit4DSurf: High-Fidelity Dynamic Scene Surface Reconstruction30 Mar 2026
- 2026Sketch2CT: Multimodal Diffusion for Structure-Aware 3D Medical Volume Generation23 Mar 2026
- 2026PAS3R: Pose-Adaptive Streaming 3D Reconstruction for Long Video Sequences22 Mar 2026
- 2026ReLi3D: Relightable Multi-view 3D Reconstruction with Disentangled Illumination20 Mar 2026
- 2026MessyKitchens: Contact-rich object-level 3D scene reconstruction17 Mar 2026
- 2026EI-Part: Explode for Completion and Implode for Refinement14 Mar 2026
- 2026On the Structural Failure of Chamfer Distance in 3D Shape Optimization10 Mar 2026
- 2026PixARMesh: Autoregressive Mesh-Native Single-View Scene Reconstruction6 Mar 2026
- 2026NOVA3R: Non-pixel-aligned Visual Transformer for Amodal 3D Reconstruction4 Mar 2026
- 2026Lie Flow: Video Dynamic Fields Modeling and Predicting with Lie Algebra as Geometric Physics Principle25 Feb 2026
- 2026Skullptor: High Fidelity 3D Head Reconstruction in Seconds with Multi-View Normal Prediction24 Feb 2026
- 2026Electrostatics-Inspired Surface Reconstruction (EISR): Recovering 3D Shapes as a Superposition of Poisson's PDE Solutions12 Feb 2026
- 2026KidMesh: Computational Mesh Reconstruction for Pediatric Congenital Hydronephrosis Using Deep Neural Networks9 Feb 2026
- 2026MGP-KAD: Multimodal Geometric Priors and Kolmogorov-Arnold Decoder for Single-View 3D Reconstruction in Complex Scenes5 Feb 2026
- 2026Optimization and Generation in Aerodynamics Inverse Design3 Feb 2026
- 2025MRD: Using Physically Based Differentiable Rendering to Probe Vision Models for 3D Scene Understanding13 Dec 2025
- 2025Voxify3D: Pixel Art Meets Volumetric Rendering8 Dec 2025
- 2025Textured Geometry Evaluation: Perceptual 3D Textured Shape Metric via 3D Latent-Geometry Network1 Dec 2025
- 2025SRAM: Shape-Realism Alignment Metric for No Reference 3D Shape Evaluation1 Dec 2025
- 2025Gaussian Swaying: Surface-Based Framework for Aerodynamic Simulation with 3D Gaussians1 Dec 2025
- 2025Cue3D: Quantifying the Role of Image Cues in Single-Image 3D Generation27 Nov 2025
50 newest of 651 All 651 (JSON)
- 2022Point-E: A System for Generating 3D Point Clouds from Complex Promptscited by 699
- 2023One-2-3-45: Any Single Image to 3D Mesh in 45 Seconds without Per-Shape Optimizationcited by 560
- 2023Magic123: One Image to High-Quality 3D Object Generation Using Both 2D and 3D Diffusion Priorscited by 397
- 2023One-2-3-45++: Fast Single Image to 3D Objects with Consistent Multi-View Generation and 3D Diffusioncited by 283
- 2022NeuralLift-360: Lifting An In-the-wild 2D Photo to A 3D Object with 360deg Viewscited by 148
- 2023HoloDiffusion: Training a 3D Diffusion Model using 2D Imagescited by 106
- 2022HouseDiffusion: Vector Floorplan Generation via a Diffusion Model with Discrete and Continuous Denoisingcited by 73
- 2025Geo4D: Leveraging Video Generators for Geometric 4D Scene Reconstructioncited by 67
- 2024You See it, You Got it: Learning 3D Creation on Pose-Free Videos at Scalecited by 65
- 2023Consistent123: One Image to Highly Consistent 3D Asset Using Case-Aware Diffusion Priorscited by 64
- 2022RGBD2: Generative Scene Synthesis via Incremental View Inpainting using RGBD Diffusion Modelscited by 45
- 2023Controllable Mesh Generation Through Sparse Latent Point Diffusion Modelscited by 41
12 most cited of 43 All 43 (JSON)
- 2026A Survey on Adversarial Attacks and Defenses for Diffusion Models Across Multiple Modalities28 Aug 2026
- 2026Sketch2CT: Multimodal Diffusion for Structure-Aware 3D Medical Volume Generation23 Mar 2026
- 2025Evaluating Latent Generative Paradigms for High-Fidelity 3D Shape Completion from a Single Depth Image14 Nov 2025
- 2025Adaptive 3D Reconstruction via Diffusion Priors and Forward Curvature-Matching Likelihood Updates9 Nov 2025
- 2025StrucADT: Generating Structure-controlled 3D Point Clouds with Adjacency Diffusion Transformer28 Sep 2025
- 2025HierOctFusion: Multi-scale Octree-based 3D Shape Generation via Part-Whole-Hierarchy Message Passing14 Aug 2025
- 2025Geometry and Perception Guided Gaussians for Multiview-consistent 3D Generation from a Single Image26 Jun 2025
- 2025Geo4D: Leveraging Video Generators for Geometric 4D Scene Reconstruction10 Apr 2025
- 2025CDI3D: Cross-guided Dense-view Interpolation for 3D Reconstruction11 Mar 2025
- 2024You See it, You Got it: Learning 3D Creation on Pose-Free Videos at Scale9 Dec 2024
- 2024ProEdit: Simple Progression is All You Need for High-Quality 3D Scene Editing7 Nov 2024
- 2024DreamHOI: Subject-Driven Generation of 3D Human-Object Interactions with Diffusion Priors12 Sep 2024
12 newest of 43 All 43 (JSON)
- 2021NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstructioncited by 1,712
- 2022TensoRF: Tensorial Radiance Fieldscited by 1,280
- 2023LRM: Large Reconstruction Model for Single Image to 3Dcited by 849
- 2023Objaverse-XL: A Universe of 10M+ 3D Objectscited by 774
- 2021Common Objects in 3D: Large-Scale Learning and Evaluation of Real-life 3D Category Reconstructioncited by 652
- 2022Point-NeRF: Point-based Neural Radiance Fieldscited by 503
- 2021Deep Marching Tetrahedra: a Hybrid Representation for High-Resolution 3D Shape Synthesiscited by 460
- 2024MonST3R: A Simple Approach for Estimating Geometry in the Presence of Motioncited by 442
- 2024InstantMesh: Efficient 3D Mesh Generation from a Single Image with Sparse-view Large Reconstruction Modelscited by 433
- 2024Metric3Dv2: A Versatile Monocular Geometric Foundation Model for Zero-shot Metric Depth and Surface Normal Estimationcited by 395
- 2023Metric3D: Towards Zero-shot Metric 3D Prediction from A Single Imagecited by 365
- 2021MonoScene: Monocular 3D Semantic Scene Completioncited by 363
12 most cited of 601 All 601 (JSON)
- 2026NOFACE3D: NOise-scheduled Focused Anchoring and Controlled Enhancement for 3D Generation9 Oct 2026
- 2026I2CD: Direct Image-to-Convex Decomposition for Simulation-Ready Collision Geometry2 Oct 2026
- 2026OptimusMesh: Compact Autoregressive Mesh Generation from Point Clouds via Sparse Latent Pivots1 Oct 2026
- 2026SPOON: Towards Coherent Compositional 3D Scene Generation from Uncalibrated Multi-view Images30 Sep 2026
- 2026RealCAD: Towards Real-World Image-to-CAD Reconstruction under Domain Shift and Parameter Bias31 Aug 2026
- 2026Reconstructing Humans and Objects in Interaction using Large Reconstruction Models27 Aug 2026
- 2026View-Adaptive Renderer for View-Consistent 2D-to-3D Generation10 Aug 2026
- 2026Learning Manifolds in High-D Point Embedding for Anisotropic Surface Approximation from Unstructured Point Clouds30 Jul 2026
- 2026StructureGS: Structure-aware Gaussian Splatting for Articulated Object Reconstruction29 Jul 2026
- 2026Scene-SAM3D: Multi-View Scene Asset Generation Without Fine-Tuning18 Jul 2026
- 2026HeartVolMesh: Cardiac Volumetric Mesh Reconstruction via Covariance-Guided Graph Deformation5 Jul 2026
- 2026Personalized 4D Whole-Heart Mesh Reconstruction from Cine MRI via Multi-Scale Temporal Modeling and Differentiable Contour Rendering2 Jul 2026
12 newest of 601 All 601 (JSON)