AnythingReality: Robust Online Gaussian Splatting SLAM for Open-Vocabulary VR Scene Exploration
Not on the map. Why?
Abstract (arXiv)
We present a novel integrated architecture for robust online 3D Gaussian splatting, real-time VR exploration, and speech-driven Vision-Language-Model interaction. Unlike methods assuming clean depth or external poses, our system combines ORB-SLAM3-based pose estimation with online Gaussian reconstruction for noisy real-world data. A VR pipeline enables immersive exploration of incremental reconstructions; a semantic module transcribes voice commands, generates scene descriptions, and records points of interest. Against state-of-the-art online Gaussian splatting methods, we improve image quality on our dataset (+14.5% PSNR, +8.6% SSIM, -14.3% LPIPS) and TUM-RGBD (+11.7% PSNR, +7.8% SSIM, -21.6% LPIPS), with comparable or superior frame rates via quality-speed configurations. We achieve an 88% VLM object-recognition rate.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 11 of its 15 references that are in the map. First posted on arXiv 10 Jul 2026.
Builds on
11 of 15 references.
References · 11
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2023Visual Instruction Tuningcited by 7,792
- 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,767
- 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 3,972
- 2021ScanQA: 3D Question Answering for Spatial Scene Understandingcited by 340
- 2024VR-GS: A Physical Dynamics-Aware Interactive Gaussian Splatting System in Virtual Realitycited by 175
- 2025GPT4Scene: Understand 3D Scenes from Videos with Vision-Language Modelscited by 106
- 20243D Vision-Language Gaussian Splattingcited by 30
- 2024Radiance Fields for Robotic Teleoperationcited by 13
- 2025Gaussian-Plus-SDF SLAM: High-fidelity 3D Reconstruction at 150+ fpscited by 11
- 2020Inspection of histological 3D reconstructions in virtual realitycited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2024DreamScene360: Unconstrained Text-to-3D Scene Generation with Panoramic Gaussian Splatting
- 20263DGSNav: Enhancing Vision-Language Model Reasoning for Object Navigation via Active 3D Gaussian Splatting
- 2026NavGSim: High-Fidelity Gaussian Splatting Simulator for Large-Scale Navigation
- 2025LVD-GS: Gaussian Splatting SLAM for Dynamic Scenes via Hierarchical Explicit-Implicit Representation Collaboration Rendering
- 2026DecoupleGS: Interactive 3D Gaussian Splatting for End-to-End Autonomous Driving Testing
- 2025SplatTalk: 3D VQA with Gaussian Splatting
- 2026X-GS: An Extensible Framework for Perceiving and Thinking with 3D Gaussian Splatting
- 2026GA-GS: Generation-Assisted Gaussian Splatting for Static Scene Reconstruction