mlsanityData to 7 Oct 2026

BakedSDF: Meshing Neural SDFs for Real-Time View Synthesis

arXiv 2302.14859 ↗First posted 28 Feb 2023cs.CVcited by 220

Not on the map. Why?

Abstract (arXiv)

We present a method for reconstructing high-quality meshes of large unbounded real-world scenes suitable for photorealistic novel view synthesis. We first optimize a hybrid neural volume-surface scene representation designed to have well-behaved level sets that correspond to surfaces in the scene. We then bake this representation into a high-quality triangle mesh, which we equip with a simple and fast view-dependent appearance model based on spherical Gaussians. Finally, we optimize this baked representation to best reproduce the captured viewpoints, resulting in a model that can leverage accelerated polygon rasterization pipelines for real-time view synthesis on commodity hardware. Our approach outperforms previous scene representations for real-time rendering in terms of accuracy, speed, and power consumption, and produces high quality meshes that enable applications such as appearance editing and physical simulation.

Key facts. Cited by 220 papers in the map (data through 7 Oct 2026). Builds on 37 of its 65 references that are in the map. First posted on arXiv 28 Feb 2023.

Builds on

37 of 65 references.

References · 37

  1. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  2. 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,698
  3. 2016Gaussian Error Linear Units (GELUs)cited by 3,431
  4. 2013Estimating or Propagating Gradients Through Stochastic Neurons for Conditional Computationcited by 2,031
  5. 2021Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance Fieldscited by 2,013
  6. 2021NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstructioncited by 1,701
  7. 2021Plenoxels: Radiance Fields without Neural Networkscited by 1,607
  8. 2022TensoRF: Tensorial Radiance Fieldscited by 1,275
  9. 2021Volume Rendering of Neural Implicit Surfacescited by 990
  10. 2021Direct Voxel Grid Optimization: Super-fast Convergence for Radiance Fields Reconstructioncited by 961
  11. 2021PlenOctrees for Real-time Rendering of Neural Radiance Fieldscited by 904
  12. 2020NeRF++: Analyzing and Improving Neural Radiance Fieldscited by 857
25 more
  1. 2020Implicit Geometric Regularization for Learning Shapescited by 707
  2. 2021KiloNeRF: Speeding up Neural Radiance Fields with Thousands of Tiny MLPscited by 672
  3. 2021UNISURF: Unifying Neural Implicit Surfaces and Radiance Fields for Multi-View Reconstructioncited by 643
  4. 2021Ref-NeRF: Structured View-Dependent Appearance for Neural Radiance Fieldscited by 569
  5. 2021FastNeRF: High-Fidelity Neural Rendering at 200FPScited by 510
  6. 2020NeRV: Neural Reflectance and Visibility Fields for Relighting and View Synthesiscited by 493
  7. 2021Baking Neural Radiance Fields for Real-Time View Synthesiscited by 465
  8. 2020NeRD: Neural Reflectance Decomposition from Image Collectionscited by 446
  9. 2021PhySG: Inverse Rendering with Spherical Gaussians for Physics-based Material Editing and Relightingcited by 332
  10. 2022MobileNeRF: Exploiting the Polygon Rasterization Pipeline for Efficient Neural Field Rendering on Mobile Architecturescited by 308
  11. 2017A General and Adaptive Robust Loss Functioncited by 236
  12. 2021DONeRF: Towards Real-Time Rendering of Compact Neural Radiance Fields using Depth Oracle Networkscited by 232
  13. 2020Free View Synthesiscited by 231
  14. 2021NeX: Real-time View Synthesis with Neural Basis Expansioncited by 215
  15. 2023MERF: Memory-Efficient Radiance Fields for Real-time View Synthesis in Unbounded Scenescited by 215
  16. 2018Stereo Magnification: Learning View Synthesis using Multiplane Imagescited by 206
  17. 2019Pushing the Boundaries of View Extrapolation with Multiplane Imagescited by 191
  18. 2021Point-Based Neural Rendering with Per-View Optimizationcited by 188
  19. 2019Neural Volumes: Learning Dynamic Renderable Volumes from Imagescited by 173
  20. 2020Stable View Synthesiscited by 165
  21. 2022NeuMesh: Learning Disentangled Neural Mesh-based Implicit Field for Geometry and Texture Editingcited by 141
  22. 2022SAMURAI: Shape And Material from Unconstrained Real-world Arbitrary Image collectionscited by 89
  23. 2022ReLU Fields: The Little Non-linearity That Couldcited by 87
  24. 2022NeROIC: Neural Rendering of Objects from Online Image Collectionscited by 36
  25. 2021Fast Training of Neural Lumigraph Representations using Meta Learningcited by 29

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 47; 2024: 101; 2025: 52; 2026: 20.

220 papers.

Sort:

By area:

  1. 20242D Gaussian Splatting for Geometrically Accurate Radiance Fieldscited by 1,061
  2. 2023Zip-NeRF: Anti-Aliased Grid-Based Neural Radiance Fieldscited by 667
  3. 2023Mip-Splatting: Alias-free 3D Gaussian Splattingcited by 661
  4. 2023SuGaR: Surface-Aligned Gaussian Splatting for Efficient 3D Mesh Reconstruction and High-Quality Mesh Renderingcited by 611
  5. 2024Gaussian Opacity Fields: Efficient Adaptive Surface Reconstruction in Unbounded Scenescited by 226
  6. 2024VastGaussian: Vast 3D Gaussians for Large Scene Reconstructioncited by 209
  7. 20233DGS-Avatar: Animatable Avatars via Deformable 3D Gaussian Splattingcited by 195
  8. 2023DreamEditor: Text-Driven 3D Scene Editing with Neural Fieldscited by 154
  9. 2023Periodic Vibration Gaussian: Dynamic Urban Scene Reconstruction and Real-time Renderingcited by 143
  10. 2024MeshLRM: Large Reconstruction Model for High-Quality Meshescited by 138
  11. 2024Recent Advances in 3D Gaussian Splattingcited by 130
  12. 2024Pixel-GS: Density Control with Pixel-aware Gradient for 3D Gaussian Splattingcited by 111
38 more
  1. 2024RadSplat: Radiance Field-Informed Gaussian Splatting for Robust Real-Time Rendering with 900+ FPScited by 110
  2. 2024RaDe-GS: Rasterizing Depth in Gaussian Splattingcited by 110
  3. 2023Delicate Textured Mesh Recovery from NeRF via Adaptive Surface Refinementcited by 106
  4. 20243DGUT: Enabling Distorted Cameras and Secondary Rays in Gaussian Splattingcited by 87
  5. 2024GSDF: 3DGS Meets SDF for Improved Rendering and Reconstructioncited by 81
  6. 2024CompGS: Efficient 3D Scene Representation via Compressed Gaussian Splattingcited by 80
  7. 20243DGSR: Implicit Surface Reconstruction with 3D Gaussian Splattingcited by 78
  8. 2024Deblurring 3D Gaussian Splattingcited by 66
  9. 2024GS2Mesh: Surface Reconstruction from Gaussian Splatting via Novel Stereo Viewscited by 65
  10. 2023SMERF: Streamable Memory Efficient Radiance Fields for Real-Time Large-Scene Explorationcited by 62
  11. 2023Tetra-NeRF: Representing Neural Radiance Fields Using Tetrahedracited by 57
  12. 2024Radiative Gaussian Splatting for Efficient X-ray Novel View Synthesiscited by 56
  13. 2023NeRFMeshing: Distilling Neural Radiance Fields into Geometrically-Accurate 3D Meshescited by 52
  14. 2024AutoSplat: Constrained Gaussian Splatting for Autonomous Driving Scene Reconstructioncited by 52
  15. 2024SplatFields: Neural Gaussian Splats for Sparse 3D and 4D Reconstructioncited by 52
  16. 2024GoMAvatar: Efficient Animatable Human Modeling from Monocular Video Using Gaussians-on-Meshcited by 51
  17. 20243D Convex Splatting: Radiance Field Rendering with 3D Smooth Convexescited by 50
  18. 2024Neural Signed Distance Function Inference through Splatting 3D Gaussians Pulled on Zero-Level Setcited by 47
  19. 2023GaussianHead: High-fidelity Head Avatars with Learnable Gaussian Derivationcited by 46
  20. 2024EVER: Exact Volumetric Ellipsoid Rendering for Real-time View Synthesiscited by 46
  21. 2023Masked Space-Time Hash Encoding for Efficient Dynamic Scene Reconstructioncited by 43
  22. 2024Binary Opacity Grids: Capturing Fine Geometric Detail for Mesh-Based View Synthesiscited by 41
  23. 2024DeferredGS: Decoupled and Editable Gaussian Splatting with Deferred Shadingcited by 40
  24. 2023Real-Time Neural Rasterization for Large Scenescited by 37
  25. 2024HDR-GS: Efficient High Dynamic Range Novel View Synthesis at 1000x Speed via Gaussian Splattingcited by 35
  26. 2024LRM-Zero: Training Large Reconstruction Models with Synthesized Datacited by 35
  27. 2024Sparse Voxels Rasterization: Real-time High-fidelity Radiance Field Renderingcited by 35
  28. 2025MILo: Mesh-In-the-Loop Gaussian Splatting for Detailed and Efficient Surface Reconstructioncited by 35
  29. 2024Efficient Perspective-Correct 3D Gaussian Splatting Using Hybrid Transparencycited by 33
  30. 2023CoGS: Controllable Gaussian Splattingcited by 32
  31. 2023Nuvo: Neural UV Mapping for Unruly 3D Representationscited by 29
  32. 2023UniSDF: Unifying Neural Representations for High-Fidelity 3D Reconstruction of Complex Scenes with Reflectionscited by 29
  33. 2024Effective Rank Analysis and Regularization for Enhanced 3D Gaussian Splattingcited by 29
  34. 2024VR-Splatting: Foveated Radiance Field Rendering via 3D Gaussian Splatting and Neural Pointscited by 29
  35. 2025DRAWER: Digital Reconstruction and Articulation With Environment Realismcited by 29
  36. 2025PolaRiS: Scalable Real-to-Sim Evaluations for Generalist Robot Policiescited by 29
  37. 2023HybridNeRF: Efficient Neural Rendering via Adaptive Volumetric Surfacescited by 28
  38. 2024Trim 3D Gaussian Splatting for Accurate Geometry Representationcited by 28

50 most cited of 220 All 220 (JSON)