mlsanityData to 14 Oct 2026

From Fields to Splats: A Cross-Domain Survey of Real-Time Neural Scene Representations

arXiv 2509.23555 ↗First posted 28 Sep 2025cs.CVcited by 1

Not on the map. Why?

Abstract (arXiv)

Neural scene representations such as Neural Radiance Fields (NeRF) and 3D Gaussian Splatting (3DGS) have transformed how 3D environments are modeled, rendered, and interpreted. NeRF introduced view-consistent photorealism via volumetric rendering; 3DGS has rapidly emerged as an explicit, efficient alternative that supports high-quality rendering, faster optimization, and integration into hybrid pipelines for enhanced photorealism and task-driven scene understanding. This survey examines how 3DGS is being adopted across SLAM, telepresence and teleoperation, robotic manipulation, and 3D content generation. Despite their differences, these domains share common goals: photorealistic rendering, meaningful 3D structure, and accurate downstream tasks. We organize the review around unified research questions that explain why 3DGS is increasingly displacing NeRF-based approaches: What technical advantages drive its adoption? How does it adapt to different input modalities and domain-specific constraints? What limitations remain? By systematically comparing domain-specific pipelines, we show that 3DGS balances photorealism, geometric fidelity, and computational efficiency. The survey offers a roadmap for leveraging neural rendering not only for image synthesis but also for perception, interaction, and content creation across real and virtual environments.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 116 of its 139 references that are in the map. First posted on arXiv 28 Sep 2025.

Builds on

116 of 139 references.

References · 116

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2023Segment Anythingcited by 8,234
  3. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
  4. 2021Vision Transformers for Dense Predictioncited by 1,803
  5. 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,567
  6. 2025VGGT: Visual Geometry Grounded Transformercited by 1,539
  7. 2019SuperGlue: Learning Feature Matching with Graph Neural Networkscited by 1,443
  8. 2017SuperPoint: Self-Supervised Interest Point Detection and Descriptioncited by 1,320
  9. 2024Grounding Image Matching in 3D with MASt3Rcited by 983
  10. 2017PoseCNN: A Convolutional Neural Network for 6D Object Pose Estimation in Cluttered Scenescited by 775
  11. 2024LGM: Large Multi-View Gaussian Model for High-Resolution 3D Content Creationcited by 739
  12. 2021Perceiver IO: A General Architecture for Structured Inputs & Outputscited by 629
38 more
  1. 2021NICE-SLAM: Neural Implicit Scalable Encoding for SLAMcited by 589
  2. 2025Continuous 3D Perception Model with Persistent Statecited by 548
  3. 2021Zero-Shot Text-Guided Object Generation with Dream Fieldscited by 513
  4. 2021iMAP: Implicit Mapping and Positioning in Real-Timecited by 476
  5. 2024MonST3R: A Simple Approach for Estimating Geometry in the Presence of Motioncited by 442
  6. 2023Gaussian Splatting SLAMcited by 415
  7. 2023SplaTAM: Splat, Track & Map 3D Gaussians for Dense RGB-D SLAMcited by 388
  8. 2020INeRF: Inverting Neural Radiance Fields for Pose Estimationcited by 382
  9. 2025Fast3R: Towards 3D Reconstruction of 1000+ Images in One Forward Passcited by 367
  10. 2019D2-Net: A Trainable CNN for Joint Detection and Description of Local Featurescited by 326
  11. 2020DISK: Learning local features with policy gradientcited by 312
  12. 2016LIFT: Learned Invariant Feature Transformcited by 306
  13. 2023GS-SLAM: Dense Visual SLAM with 3D Gaussian Splattingcited by 278
  14. 20243D Reconstruction with Spatial Memorycited by 277
  15. 2023Visual Geometry Grounded Deep Structure From Motioncited by 227
  16. 2024Global Structure-from-Motion Revisitedcited by 218
  17. 2024MASt3R-SLAM: Real-Time Dense SLAM with 3D Reconstruction Priorscited by 205
  18. 2024WonderWorld: Interactive 3D Scene Generation from a Single Imagecited by 202
  19. 2023DreamGaussian4D: Generative 4D Gaussian Splattingcited by 194
  20. 2018DeepV2D: Video to Depth with Differentiable Structure from Motioncited by 185
  21. 2025FLARE: Feed-forward Geometry, Appearance and Camera Estimation from Uncalibrated Sparse Viewscited by 180
  22. 2024VR-GS: A Physical Dynamics-Aware Interactive Gaussian Splatting System in Virtual Realitycited by 179
  23. 2024Splatt3R: Zero-shot Gaussian Splatting from Uncalibrated Image Pairscited by 178
  24. 2018BA-Net: Dense Bundle Adjustment Networkcited by 175
  25. 2023Align Your Gaussians: Text-to-4D with Dynamic 3D Gaussians and Composed Diffusion Modelscited by 169
  26. 2024MASt3R-SfM: a Fully-Integrated Solution for Unconstrained Structure-from-Motioncited by 162
  27. 2023Photo-SLAM: Real-time Simultaneous Localization and Photorealistic Mapping for Monocular, Stereo, and RGB-D Camerascited by 141
  28. 2025VGGT-SLAM: Dense RGB SLAM Optimized on the SL(4) Manifoldcited by 136
  29. 2023GO-SLAM: Global Optimization for Consistent 3D Instant Reconstructioncited by 133
  30. 2023Consistent4D: Consistent 360deg Dynamic Object Generation from Monocular Videocited by 125
  31. 2023Text2NeRF: Text-Driven 3D Scene Generation with Neural Radiance Fieldscited by 123
  32. 2021Dex-NeRF: Using a Neural Radiance Field to Grasp Transparent Objectscited by 119
  33. 2024Flash3D: Feed-Forward Generalisable 3D Scene Reconstruction from a Single Imagecited by 116
  34. 2024RealmDreamer: Text-Driven 3D Scene Generation with Inpainting and Depth Diffusioncited by 109
  35. 2024ManiGaussian: Dynamic Gaussian Splatting for Multi-task Robotic Manipulationcited by 108
  36. 20243D Gaussian as a New Era: A Surveycited by 104
  37. 2024GaussianFlow: Splatting Gaussian Dynamics for 4D Content Creationcited by 100
  38. 2025Aether: Geometric-Aware Unified World Modelingcited by 97

50 most cited of 116 All 116 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.