From Fields to Splats: A Cross-Domain Survey of Real-Time Neural Scene Representations
Not on the map. Why?
Abstract (arXiv)
Neural scene representations such as Neural Radiance Fields (NeRF) and 3D Gaussian Splatting (3DGS) have transformed how 3D environments are modeled, rendered, and interpreted. NeRF introduced view-consistent photorealism via volumetric rendering; 3DGS has rapidly emerged as an explicit, efficient alternative that supports high-quality rendering, faster optimization, and integration into hybrid pipelines for enhanced photorealism and task-driven scene understanding. This survey examines how 3DGS is being adopted across SLAM, telepresence and teleoperation, robotic manipulation, and 3D content generation. Despite their differences, these domains share common goals: photorealistic rendering, meaningful 3D structure, and accurate downstream tasks. We organize the review around unified research questions that explain why 3DGS is increasingly displacing NeRF-based approaches: What technical advantages drive its adoption? How does it adapt to different input modalities and domain-specific constraints? What limitations remain? By systematically comparing domain-specific pipelines, we show that 3DGS balances photorealism, geometric fidelity, and computational efficiency. The survey offers a roadmap for leveraging neural rendering not only for image synthesis but also for perception, interaction, and content creation across real and virtual environments.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 116 of its 139 references that are in the map. First posted on arXiv 28 Sep 2025.
Builds on
116 of 139 references.
References · 116
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2023Segment Anythingcited by 8,234
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
- 2021Vision Transformers for Dense Predictioncited by 1,803
- 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,567
- 2025VGGT: Visual Geometry Grounded Transformercited by 1,539
- 2019SuperGlue: Learning Feature Matching with Graph Neural Networkscited by 1,443
- 2017SuperPoint: Self-Supervised Interest Point Detection and Descriptioncited by 1,320
- 2024Grounding Image Matching in 3D with MASt3Rcited by 983
- 2017PoseCNN: A Convolutional Neural Network for 6D Object Pose Estimation in Cluttered Scenescited by 775
- 2024LGM: Large Multi-View Gaussian Model for High-Resolution 3D Content Creationcited by 739
- 2021Perceiver IO: A General Architecture for Structured Inputs & Outputscited by 629
38 more
- 2021NICE-SLAM: Neural Implicit Scalable Encoding for SLAMcited by 589
- 2025Continuous 3D Perception Model with Persistent Statecited by 548
- 2021Zero-Shot Text-Guided Object Generation with Dream Fieldscited by 513
- 2021iMAP: Implicit Mapping and Positioning in Real-Timecited by 476
- 2024MonST3R: A Simple Approach for Estimating Geometry in the Presence of Motioncited by 442
- 2023Gaussian Splatting SLAMcited by 415
- 2023SplaTAM: Splat, Track & Map 3D Gaussians for Dense RGB-D SLAMcited by 388
- 2020INeRF: Inverting Neural Radiance Fields for Pose Estimationcited by 382
- 2025Fast3R: Towards 3D Reconstruction of 1000+ Images in One Forward Passcited by 367
- 2019D2-Net: A Trainable CNN for Joint Detection and Description of Local Featurescited by 326
- 2020DISK: Learning local features with policy gradientcited by 312
- 2016LIFT: Learned Invariant Feature Transformcited by 306
- 2023GS-SLAM: Dense Visual SLAM with 3D Gaussian Splattingcited by 278
- 20243D Reconstruction with Spatial Memorycited by 277
- 2023Visual Geometry Grounded Deep Structure From Motioncited by 227
- 2024Global Structure-from-Motion Revisitedcited by 218
- 2024MASt3R-SLAM: Real-Time Dense SLAM with 3D Reconstruction Priorscited by 205
- 2024WonderWorld: Interactive 3D Scene Generation from a Single Imagecited by 202
- 2023DreamGaussian4D: Generative 4D Gaussian Splattingcited by 194
- 2018DeepV2D: Video to Depth with Differentiable Structure from Motioncited by 185
- 2025FLARE: Feed-forward Geometry, Appearance and Camera Estimation from Uncalibrated Sparse Viewscited by 180
- 2024VR-GS: A Physical Dynamics-Aware Interactive Gaussian Splatting System in Virtual Realitycited by 179
- 2024Splatt3R: Zero-shot Gaussian Splatting from Uncalibrated Image Pairscited by 178
- 2018BA-Net: Dense Bundle Adjustment Networkcited by 175
- 2023Align Your Gaussians: Text-to-4D with Dynamic 3D Gaussians and Composed Diffusion Modelscited by 169
- 2024MASt3R-SfM: a Fully-Integrated Solution for Unconstrained Structure-from-Motioncited by 162
- 2023Photo-SLAM: Real-time Simultaneous Localization and Photorealistic Mapping for Monocular, Stereo, and RGB-D Camerascited by 141
- 2025VGGT-SLAM: Dense RGB SLAM Optimized on the SL(4) Manifoldcited by 136
- 2023GO-SLAM: Global Optimization for Consistent 3D Instant Reconstructioncited by 133
- 2023Consistent4D: Consistent 360deg Dynamic Object Generation from Monocular Videocited by 125
- 2023Text2NeRF: Text-Driven 3D Scene Generation with Neural Radiance Fieldscited by 123
- 2021Dex-NeRF: Using a Neural Radiance Field to Grasp Transparent Objectscited by 119
- 2024Flash3D: Feed-Forward Generalisable 3D Scene Reconstruction from a Single Imagecited by 116
- 2024RealmDreamer: Text-Driven 3D Scene Generation with Inpainting and Depth Diffusioncited by 109
- 2024ManiGaussian: Dynamic Gaussian Splatting for Multi-task Robotic Manipulationcited by 108
- 20243D Gaussian as a New Era: A Surveycited by 104
- 2024GaussianFlow: Splatting Gaussian Dynamics for 4D Content Creationcited by 100
- 2025Aether: Geometric-Aware Unified World Modelingcited by 97
50 most cited of 116 All 116 (JSON)
Built on by
Citing papers per year: 2026: 1.
1 paper.