mlsanityData to 7 Oct 2026

AnythingReality: Robust Online Gaussian Splatting SLAM for Open-Vocabulary VR Scene Exploration

arXiv 2607.09260 ↗First posted 10 Jul 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

We present a novel integrated architecture for robust online 3D Gaussian splatting, real-time VR exploration, and speech-driven Vision-Language-Model interaction. Unlike methods assuming clean depth or external poses, our system combines ORB-SLAM3-based pose estimation with online Gaussian reconstruction for noisy real-world data. A VR pipeline enables immersive exploration of incremental reconstructions; a semantic module transcribes voice commands, generates scene descriptions, and records points of interest. Against state-of-the-art online Gaussian splatting methods, we improve image quality on our dataset (+14.5% PSNR, +8.6% SSIM, -14.3% LPIPS) and TUM-RGBD (+11.7% PSNR, +7.8% SSIM, -21.6% LPIPS), with comparable or superior frame rates via quality-speed configurations. We achieve an 88% VLM object-recognition rate.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 11 of its 15 references that are in the map. First posted on arXiv 10 Jul 2026.

Builds on

11 of 15 references.

References · 11

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2023Visual Instruction Tuningcited by 7,792
  3. 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,767
  4. 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 3,972
  5. 2021ScanQA: 3D Question Answering for Spatial Scene Understandingcited by 340
  6. 2024VR-GS: A Physical Dynamics-Aware Interactive Gaussian Splatting System in Virtual Realitycited by 175
  7. 2025GPT4Scene: Understand 3D Scenes from Videos with Vision-Language Modelscited by 106
  8. 20243D Vision-Language Gaussian Splattingcited by 30
  9. 2024Radiance Fields for Robotic Teleoperationcited by 13
  10. 2025Gaussian-Plus-SDF SLAM: High-fidelity 3D Reconstruction at 150+ fpscited by 11
  11. 2020Inspection of histological 3D reconstructions in virtual realitycited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2024DreamScene360: Unconstrained Text-to-3D Scene Generation with Panoramic Gaussian Splatting
  2. 20263DGSNav: Enhancing Vision-Language Model Reasoning for Object Navigation via Active 3D Gaussian Splatting
  3. 2026NavGSim: High-Fidelity Gaussian Splatting Simulator for Large-Scale Navigation
  4. 2025LVD-GS: Gaussian Splatting SLAM for Dynamic Scenes via Hierarchical Explicit-Implicit Representation Collaboration Rendering
  5. 2026DecoupleGS: Interactive 3D Gaussian Splatting for End-to-End Autonomous Driving Testing
  6. 2025SplatTalk: 3D VQA with Gaussian Splatting
  7. 2026X-GS: An Extensible Framework for Perceiving and Thinking with 3D Gaussian Splatting
  8. 2026GA-GS: Generation-Assisted Gaussian Splatting for Static Scene Reconstruction