mlsanityData to 14 Oct 2026

Flexible Techniques for Differentiable Rendering with 3D Gaussians

arXiv 2308.14737 ↗First posted 28 Aug 2023cs.CV cs.AI cs.GRcited by 28

Not on the map. Why?

Abstract (arXiv)

Fast, reliable shape reconstruction is an essential ingredient in many computer vision applications. Neural Radiance Fields demonstrated that photorealistic novel view synthesis is within reach, but was gated by performance requirements for fast reconstruction of real scenes and objects. Several recent approaches have built on alternative shape representations, in particular, 3D Gaussians. We develop extensions to these renderers, such as integrating differentiable optical flow, exporting watertight meshes and rendering per-ray normals. Additionally, we show how two of the recent methods are interoperable with each other. These reconstructions are quick, robust, and easily performed on GPU or CPU. For code and visual examples, see https://leonidk.github.io/fmb-plus

Key facts. Cited by 28 papers in the map (data through 14 Oct 2026). Builds on 31 of its 76 references that are in the map. First posted on arXiv 28 Aug 2023.

Builds on

31 of 76 references.

References · 31

  1. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  2. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
  3. 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,723
  4. 2021Plenoxels: Radiance Fields without Neural Networkscited by 1,613
  5. 2020Accelerating 3D Deep Learning with PyTorch3Dcited by 784
  6. 2020Neural Scene Flow Fields for Space-Time View Synthesis of Dynamic Scenescited by 751
  7. 2023Dynamic 3D Gaussians: Tracking by Persistent Dynamic View Synthesiscited by 737
  8. 2021Common Objects in 3D: Large-Scale Learning and Evaluation of Real-life 3D Category Reconstructioncited by 652
  9. 2023Nerfstudio: A Modular Framework for Neural Radiance Field Developmentcited by 600
  10. 2020Modular Primitives for High-Performance Differentiable Renderingcited by 441
  11. 2022XMem: Long-Term Video Object Segmentation with an Atkinson-Shiffrin Memory Modelcited by 439
  12. 2017Neural 3D Mesh Renderercited by 437
19 more
  1. 2019Soft Rasterizer: A Differentiable Renderer for Image-based 3D Reasoningcited by 420
  2. 2022MobileNeRF: Exploiting the Polygon Rasterization Pipeline for Efficient Neural Field Rendering on Mobile Architecturescited by 311
  3. 2022Unifying Flow, Stereo and Depth Estimationcited by 275
  4. 2019Differentiable Surface Splatting for Point-based Geometry Processingcited by 239
  5. 2022Particle Video Revisited: Tracking Through Occlusions Using Point Trajectoriescited by 217
  6. 2016Thingi10K: A Dataset of 10,000 3D-Printing Modelscited by 183
  7. 2021LASR: Learning Articulated Shape Reconstruction from a Monocular Videocited by 116
  8. 2018Unsupervised Learning of Shape and Pose with Differentiable Point Cloudscited by 89
  9. 2021Subdivision-Based Mesh Convolution Networkscited by 60
  10. 2023NeRFMeshing: Distilling Neural Radiance Fields into Geometrically-Accurate 3D Meshescited by 53
  11. 2022Approximate Differentiable Rendering with Algebraic Surfacescited by 44
  12. 2023Nerflets: Local Radiance Fields for Efficient Structure-Aware 3D Scene Representation from 2D Supervisioncited by 44
  13. 2022HDR-Plenoxels: Self-Calibrating High Dynamic Range Radiance Fieldscited by 40
  14. 2020PointGMM: a Neural GMM Network for Point Cloudscited by 33
  15. 2023VMesh: Hybrid Volume-Mesh Representation for Efficient View Synthesiscited by 25
  16. 2022VoGE: A Differentiable Volume Renderer using Gaussian Ellipsoids for Analysis-by-Synthesiscited by 22
  17. 2023Probabilistic Point Cloud Modeling via Self-Organizing Gaussian Mixture Modelscited by 7
  18. 2020GMMLoc: Structure Consistent Visual Localization with Gaussian Mixture Modelscited by 5
  19. 2020MRFMap: Online Probabilistic 3D Mapping using Forward Ray Sensor Modelscited by 4

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2023: 13; 2024: 11; 2025: 3; 2026: 1.

28 papers.

Sort:

By area:

  1. 20234D Gaussian Splatting for Real-Time Dynamic Scene Renderingcited by 1,157
  2. 20242D Gaussian Splatting for Geometrically Accurate Radiance Fieldscited by 1,076
  3. 2023Deformable 3D Gaussians for High-Fidelity Monocular Dynamic Scene Reconstructioncited by 759
  4. 2023LightGaussian: Unbounded 3D Gaussian Compression with 15x Reduction and 200+ FPScited by 436
  5. 2023SplaTAM: Splat, Track & Map 3D Gaussians for Dense RGB-D SLAMcited by 388
  6. 2023SC-GS: Sparse-Controlled Gaussian Splatting for Editable Dynamic Scenescited by 347
  7. 2023GS-SLAM: Dense Visual SLAM with 3D Gaussian Splattingcited by 278
  8. 2023GS-IR: 3D Gaussian Splatting for Inverse Renderingcited by 224
  9. 2024MoSca: Dynamic Gaussian Fusion from Casual Videos via 4D Motion Scaffoldscited by 179
  10. 2023Relightable 3D Gaussians: Realistic Point Cloud Relighting with BRDF Decomposition and Ray Tracingcited by 142
  11. 20243D Gaussian Ray Tracing: Fast Tracing of Particle Scenescited by 139
  12. 2024DN-Splatter: Depth and Normal Priors for Gaussian Splatting and Meshingcited by 138
16 more
  1. 2023GART: Gaussian Articulated Template Modelscited by 121
  2. 2024Dynamic Gaussian Marbles for Novel View Synthesis of Casual Monocular Videoscited by 97
  3. 2024Spec-Gaussian: Anisotropic View-Dependent Appearance for 3D Gaussian Splattingcited by 74
  4. 2024GaMeS: Mesh-Based Adapting and Modification of Gaussian Splattingcited by 70
  5. 2023DISTWAR: Fast Differentiable Rendering on Raster-based Rendering Pipelinescited by 36
  6. 2023Gaussian Splatting with NeRF-based Color and Opacitycited by 30
  7. 2023HybridNeRF: Efficient Neural Rendering via Adaptive Volumetric Surfacescited by 28
  8. 2024Neural Directional Encoding for Efficient and Accurate View-Dependent Appearance Modelingcited by 16
  9. 2023Learning Neural Implicit through Volume Rendering with Attentive Depth Fusion Priorscited by 11
  10. 2024GlanceVAD: Exploring Glance Supervision for Label-efficient Video Anomaly Detectioncited by 7
  11. 2025Articulate That Object Part (ATOP): 3D Part Articulation via Text and Motion Personalizationcited by 7
  12. 2024PanoSLAM: Panoptic 3D Scene Reconstruction via Gaussian SLAMcited by 3
  13. 2025Uni-Render: A Unified Accelerator for Real-Time Rendering Across Diverse Neural Rendererscited by 2
  14. 2024Alpha Invariance: On Inverse Scaling Between Distance and Volume Density in Neural Radiance Fieldscited by 1
  15. 2025STAMICS: Splat, Track And Map with Integrated Consistency and Semantics for Dense RGB-D SLAMcited by 0
  16. 2026WebSpline: Structure-Informed Splines for Real-Time 3D Gaussians from Monocular Videoscited by 0