mlsanityData to 14 Oct 2026

Neural 3D Mesh Renderer

arXiv 1711.07566 ↗First posted 20 Nov 2017cs.CV cs.LGcited by 437

Not on the map. Why?

Abstract (arXiv)

For modeling the 3D world behind 2D images, which 3D representation is most appropriate? A polygon mesh is a promising candidate for its compactness and geometric properties. However, it is not straightforward to model a polygon mesh from 2D images using neural networks because the conversion from a mesh to an image, or rendering, involves a discrete operation called rasterization, which prevents back-propagation. Therefore, in this work, we propose an approximate gradient for rasterization that enables the integration of rendering into neural networks. Using this renderer, we perform single-image 3D mesh reconstruction with silhouette image supervision and our system outperforms the existing voxel-based approach. Additionally, we perform gradient-based 3D mesh editing operations, such as 2D-to-3D style transfer and 3D DeepDream, with 2D supervision for the first time. These applications demonstrate the potential of the integration of a mesh renderer into neural networks and the effectiveness of our proposed renderer.

Key facts. Cited by 437 papers in the map (data through 14 Oct 2026). First posted on arXiv 20 Nov 2017.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2021: 118; 2022: 107; 2023: 93; 2024: 62; 2025: 30; 2026: 27.

437 papers.

Sort:

By area:

  1. 2021NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstructioncited by 1,712
  2. 2023Objaverse-XL: A Universe of 10M+ 3D Objectscited by 774
  3. 2021Common Objects in 3D: Large-Scale Learning and Evaluation of Real-life 3D Category Reconstructioncited by 652
  4. 2022Kubric: A scalable dataset generatorcited by 381
  5. 2021Advances in Neural Renderingcited by 365
  6. 2023Splatter Image: Ultra-Fast Single-View 3D Reconstructioncited by 364
  7. 2021PARE: Part Attention Regressor for 3D Human Body Estimationcited by 337
  8. 2021Text2Mesh: Text-Driven Neural Stylization for Meshescited by 334
  9. 2021Light Field Networks: Neural Scene Representations with Single-Evaluation Renderingcited by 332
  10. 2021Mixture of Volumetric Primitives for Efficient Neural Renderingcited by 277
  11. 2021HeadNeRF: A Real-time NeRF-based Parametric Head Modelcited by 228
  12. 2021Scene Representation Transformer: Geometry-Free Novel View Synthesis Through Set-Latent Scene Representationscited by 227
38 more
  1. 2021DexMV: Imitation Learning for Dexterous Manipulation from Human Videoscited by 206
  2. 2023MeshDiffusion: Score-based Generative 3D Mesh Modelingcited by 199
  3. 2021CodeNeRF: Disentangled Neural Radiance Fields for Object Categoriescited by 183
  4. 2023NerfDiff: Single-image View Synthesis with NeRF-guided Distillation from 3D-aware Diffusioncited by 180
  5. 2023NeRO: Neural Geometry and BRDF Reconstruction of Reflective Objects from Multiview Imagescited by 163
  6. 2022Dream3D: Zero-Shot Text-to-3D Synthesis Using 3D Shape Prior and Text-to-Image Diffusion Modelscited by 151
  7. 2024MeshAnything: Artist-Created Mesh Generation with Autoregressive Transformerscited by 144
  8. 2023Flexible Isosurface Extraction for Gradient-Based Mesh Optimizationcited by 139
  9. 2021NeRS: Neural Reflectance Surfaces for Sparse-view 3D Reconstruction in the Wildcited by 136
  10. 2021Real-time Deep Dynamic Characterscited by 133
  11. 2022OakInk: A Large-scale Knowledge Repository for Understanding Hand-Object Interactioncited by 131
  12. 2022Diffusion-SDF: Text-to-Shape via Voxelized Diffusioncited by 128
  13. 2022NeRF-Art: Text-Driven Neural Radiance Fields Stylizationcited by 126
  14. 2022Neural Rendering for Stereo 3D Reconstruction of Deformable Tissues in Robotic Surgerycited by 123
  15. 2024Gaussian in the Wild: 3D Gaussian Splatting for Unconstrained Image Collectionscited by 117
  16. 2022ZebraPose: Coarse to Fine Surface Encoding for 6DoF Object Pose Estimationcited by 116
  17. 2022Is Attention All That NeRF Needs?cited by 113
  18. 2022MagicPony: Learning Articulated 3D Animals in the Wildcited by 112
  19. 2022Vision Transformer for NeRF-Based View Synthesis from a Single Input Imagecited by 104
  20. 2021Stylizing 3D Scene via Implicit Representation and HyperNetworkcited by 103
  21. 2021Invisible for both Camera and LiDAR: Security of Multi-Sensor Fusion based Perception in Autonomous Driving Under Physical-World Attackscited by 101
  22. 2021gradSim: Differentiable simulation for system identification and visuomotor controlcited by 100
  23. 2021NeRF-SR: High-Quality Neural Radiance Fields using Supersamplingcited by 95
  24. 2022InterCap: Joint Markerless 3D Tracking of Humans and Objects in Interactioncited by 93
  25. 2024GES: Generalized Exponential Splatting for Efficient Radiance Field Renderingcited by 92
  26. 2021AutoShape: Real-Time Shape-Aware Monocular 3D Object Detectioncited by 87
  27. 2022Learning Smooth Neural Functions via Lipschitz Regularizationcited by 86
  28. 2023AvatarCraft: Transforming Text into Neural Human Avatars with Parameterized Shape and Pose Controlcited by 84
  29. 2022TANGO: Text-driven Photorealistic and Robust 3D Stylization via Lighting Decompositioncited by 83
  30. 2021PixelSynth: Generating a 3D-Consistent Experience from a Single Imagecited by 82
  31. 2022Deforming Radiance Fields with Cagescited by 78
  32. 2021Learning to Stylize Novel Viewscited by 76
  33. 2021MeshUDF: Fast and Differentiable Meshing of Unsigned Distance Field Networkscited by 76
  34. 2021GeoSim: Realistic Video Simulation via Geometry-Aware Composition for Self-Drivingcited by 75
  35. 2021FCA: Learning a 3D Full-coverage Vehicle Camouflage for Multi-view Physical Adversarial Attackcited by 74
  36. 2022ShAPO: Implicit Representations for Multi-Object Shape, Appearance, and Pose Optimizationcited by 72
  37. 2023Multiview Compressive Coding for 3D Reconstructioncited by 71
  38. 2022CenterSnap: Single-Shot Multi-Object 3D Shape Reconstruction and Categorical 6D Pose and Size Estimationcited by 70

50 most cited of 437 All 437 (JSON)