mlsanityData to 7 Oct 2026

Modular Primitives for High-Performance Differentiable Rendering

arXiv 2011.03277 ↗First posted 6 Nov 2020cs.GR cs.CV cs.LGcited by 439

Not on the map. Why?

Cited by 81 in Diffusion models, but placed by its own abstract, which didn’t fit.

Abstract (arXiv)

We present a modular differentiable renderer design that yields performance superior to previous methods by leveraging existing, highly optimized hardware graphics pipelines. Our design supports all crucial operations in a modern graphics pipeline: rasterizing large numbers of triangles, attribute interpolation, filtered texture lookups, as well as user-programmable shading and geometry processing, all in high resolutions. Our modular primitives allow custom, high-performance graphics pipelines to be built directly within automatic differentiation frameworks such as PyTorch or TensorFlow. As a motivating application, we formulate facial performance capture as an inverse rendering problem and show that it can be solved efficiently using our tools. Our results indicate that this simple and straightforward approach achieves excellent geometric correspondence between rendered results and reference imagery.

Key facts. Cited by 439 papers in the map (data through 7 Oct 2026). First posted on arXiv 6 Nov 2020.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 13; 2022: 38; 2023: 95; 2024: 126; 2025: 83; 2026: 84.

439 papers.

Sort:

By area:

  1. 2022Magic3D: High-Resolution Text-to-3D Content Creationcited by 1,285
  2. 2023DreamGaussian: Generative Gaussian Splatting for Efficient 3D Content Creationcited by 837
  3. 2024Structured 3D Latents for Scalable and Versatile 3D Generationcited by 742
  4. 2024LGM: Large Multi-View Gaussian Model for High-Resolution 3D Content Creationcited by 730
  5. 2022Point-E: A System for Generating 3D Point Clouds from Complex Promptscited by 694
  6. 2023Fantasia3D: Disentangling Geometry and Appearance for High-quality Text-to-3D Content Creationcited by 684
  7. 2022LION: Latent Point Diffusion Models for 3D Shape Generationcited by 552
  8. 2022GET3D: A Generative Model of High Quality 3D Textured Shapes Learned from Imagescited by 446
  9. 2023FoundationPose: Unified 6D Pose Estimation and Tracking of Novel Objectscited by 411
  10. 2023Shap-E: Generating Conditional 3D Implicit Functionscited by 379
  11. 2021Extracting Triangular 3D Models, Materials, and Lighting From Imagescited by 363
  12. 2022CLIP-Mesh: Generating textured meshes from text using pretrained image-text modelscited by 281
38 more
  1. 2021Mixture of Volumetric Primitives for Efficient Neural Renderingcited by 277
  2. 2023GaussianAvatars: Photorealistic Head Avatars with Rigged 3D Gaussianscited by 256
  3. 2021HeadNeRF: A Real-time NeRF-based Parametric Head Modelcited by 228
  4. 2024A Survey on 3D Gaussian Splattingcited by 221
  5. 2021GRAM: Generative Radiance Manifolds for 3D-Aware Image Generationcited by 216
  6. 20233DGen: Triplane Latent Diffusion for Textured Mesh Generationcited by 181
  7. 2023RichDreamer: A Generalizable Normal-Depth Diffusion Model for Detail Richness in Text-to-3Dcited by 168
  8. 2022Shape, Light, and Material Decomposition from Images using Monte Carlo Rendering and Denoisingcited by 163
  9. 2023Tri-MipRF: Tri-Mip Representation for Efficient Anti-Aliasing Neural Radiance Fieldscited by 142
  10. 2023Flexible Isosurface Extraction for Gradient-Based Mesh Optimizationcited by 138
  11. 2024MeshLRM: Large Reconstruction Model for High-Quality Meshescited by 138
  12. 2021NeRS: Neural Reflectance Surfaces for Sparse-view 3D Reconstruction in the Wildcited by 136
  13. 2023TextMesh: Generation of Realistic 3D Meshes From Text Promptscited by 135
  14. 2024Unique3D: High-Quality and Efficient 3D Mesh Generation from a Single Imagecited by 132
  15. 2023Text-to-3D with Classifier Score Distillationcited by 127
  16. 2023GART: Gaussian Articulated Template Modelscited by 121
  17. 2022Realistic One-shot Mesh-based Head Avatarscited by 119
  18. 2022IRON: Inverse Rendering by Optimizing Neural SDFs and Materials from Photometric Imagescited by 110
  19. 2023TADA! Text to Animatable Digital Avatarscited by 109
  20. 2023Delicate Textured Mesh Recovery from NeRF via Adaptive Surface Refinementcited by 106
  21. 2023TeCH: Text-guided Reconstruction of Lifelike Clothed Humanscited by 104
  22. 2025CAST: Component-Aligned 3D Scene Reconstruction from an RGB Imagecited by 101
  23. 2024Era3D: High-Resolution Multiview Diffusion using Efficient Row-wise Attentioncited by 99
  24. 2025Hi3DGen: High-fidelity 3D Geometry Generation from Images via Normal Bridgingcited by 95
  25. 2023TextDeformer: Geometry Manipulation using Text Guidancecited by 94
  26. 2024Dora: Sampling and Benchmarking for 3D Shape Variational Auto-Encoderscited by 93
  27. 2024V3D: Video Diffusion Models are Effective 3D Generatorscited by 88
  28. 2022Multiface: A Dataset for Neural Face Renderingcited by 87
  29. 2023TexFusion: Synthesizing 3D Textures with Text-Guided Image Diffusion Modelscited by 86
  30. 2023Paint-it: Text-to-Texture Synthesis via Deep Convolutional Texture Map Optimization and Physically-Based Renderingcited by 84
  31. 2023Consistent-1-to-3: Consistent Image to 3D View Synthesis via Geometry-aware Diffusion Modelscited by 79
  32. 2025SparseFlex: High-Resolution and Arbitrary-Topology 3D Shape Modelingcited by 76
  33. 2022GRAM-HD: 3D-Consistent Image Generation at High Resolution with Generative Radiance Manifoldscited by 73
  34. 20243DTopia: Large Text-to-3D Generation Model with Hybrid Diffusion Priorscited by 72
  35. 2021Unified Shape and SVBRDF Recovery using Differentiable Monte Carlo Renderingcited by 71
  36. 2024IntrinsicAnything: Learning Diffusion Priors for Inverse Rendering Under Unknown Illuminationcited by 67
  37. 2023SALAD: Part-Level Latent Diffusion for 3D Shape Generation and Manipulationcited by 66
  38. 2022Texturify: Generating Textures on 3D Shape Surfacescited by 65

50 most cited of 439 All 439 (JSON)