mlsanityData to 7 Oct 2026

OnlineX: Unified Online 3D Reconstruction and Understanding with Active-to-Stable State Evolution

arXiv 2603.02134 ↗First posted 2 Mar 2026cs.CVcited by 1

Not on the map. Why?

Abstract (arXiv)

Recent advances in generalizable 3D Gaussian Splatting (3DGS) have enabled rapid 3D scene reconstruction within seconds, eliminating the need for per-scene optimization. However, existing methods primarily follow an offline reconstruction paradigm, lacking the capacity for continuous reconstruction, which limits their applicability to online scenarios such as robotics and VR/AR. In this paper, we introduce OnlineX, a feed-forward framework that reconstructs both 3D visual appearance and language fields in an online manner using only streaming images. A key challenge in online formulation is the cumulative drift issue, which is rooted in the fundamental conflict between two opposing roles of the memory state: an active role that constantly refreshes to capture high-frequency local geometry, and a stable role that conservatively accumulates and preserves the long-term global structure. To address this, we introduce a decoupled active-to-stable state evolution paradigm. Our framework decouples the memory state into a dedicated active state and a persistent stable state, and then cohesively fuses the information from the former into the latter to achieve both fidelity and stability. Moreover, we jointly model visual appearance and language fields and incorporate an implicit Gaussian fusion module to enhance reconstruction quality. Experiments on mainstream datasets demonstrate that our method consistently outperforms prior work in novel view synthesis and semantic understanding, showcasing robust performance across input sequences of varying lengths with real-time inference speed.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 46 of its 54 references that are in the map. First posted on arXiv 2 Mar 2026.

Builds on

46 of 54 references.

References · 46

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  3. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  4. 2023Segment Anythingcited by 8,158
  5. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
  6. 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,088
  7. 2021Vision Transformers for Dense Predictioncited by 1,789
  8. 2017Decoupled Weight Decay Regularizationcited by 1,722
  9. 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,526
  10. 2024Grounding Image Matching in 3D with MASt3Rcited by 960
  11. 2023Dynamic 3D Gaussians: Tracking by Persistent Dynamic View Synthesiscited by 731
  12. 2021DROID-SLAM: Deep Visual SLAM for Monocular, Stereo, and RGB-D Camerascited by 673
34 more
  1. 2023pixelSplat: 3D Gaussian Splats from Image Pairs for Scalable Generalizable 3D Reconstructioncited by 668
  2. 2023Mip-Splatting: Alias-free 3D Gaussian Splattingcited by 661
  3. 20163D-R2N2: A Unified Approach for Single and Multi-view 3D Object Reconstructioncited by 587
  4. 2024MVSplat: Efficient 3D Gaussian Splatting from Sparse Multi-View Imagescited by 553
  5. 2025Continuous 3D Perception Model with Persistent Statecited by 527
  6. 2023DL3DV-10K: A Large-Scale Scene Dataset for Deep Learning-based 3D Visioncited by 514
  7. 2024MonST3R: A Simple Approach for Estimating Geometry in the Presence of Motioncited by 431
  8. 2023LangSplat: 3D Language Gaussian Splattingcited by 410
  9. 2023Gaussian Grouping: Segment and Edit Anything in 3D Scenescited by 387
  10. 20243D Reconstruction with Spatial Memorycited by 269
  11. 2023Triplane Meets Gaussian Splatting: Fast and Generalizable Single-View 3D Reconstruction with Transformerscited by 257
  12. 2021NeuralRecon: Real-Time Coherent 3D Reconstruction from Monocular Videocited by 241
  13. 2024No Pose, No Problem: Surprisingly Simple 3D Gaussian Splats from Sparse Unposed Imagescited by 241
  14. 2024Octree-GS: Towards Consistent Real-time Rendering with LOD-Structured 3D Gaussianscited by 225
  15. 2017Learning a Multi-View Stereo Machinecited by 194
  16. 2025FLARE: Feed-forward Geometry, Appearance and Camera Estimation from Uncalibrated Sparse Viewscited by 176
  17. 2024Splatt3R: Zero-shot Gaussian Splatting from Uncalibrated Image Pairscited by 171
  18. 2023GPS-Gaussian: Generalizable Pixel-wise 3D Gaussian Splatting for Real-time Human Novel View Synthesiscited by 170
  19. 2023NICER-SLAM: Neural Implicit Scene Encoding for RGB SLAMcited by 162
  20. 2024latentSplat: Autoencoding Variational Gaussians for Fast Generalizable 3D Reconstructioncited by 114
  21. 2022NeRFusion: Fusing Radiance Fields for Large-Scale Scene Reconstructioncited by 99
  22. 2022ParticleSfM: Exploiting Dense Point Trajectories for Localizing Moving Cameras in the Wildcited by 90
  23. 2024LEAP-VO: Long-term Effective Any Point Tracking for Visual Odometrycited by 54
  24. 2024GOI: Find 3D Gaussians of Interest with an Optimizable Open-vocabulary Semantic-space Hyperplanecited by 53
  25. 2025SceneSplat: Gaussian Splatting-based Scene Understanding with Vision-Language Pretrainingcited by 51
  26. 2025LONG3R: Long Sequence Streaming 3D Reconstructioncited by 45
  27. 2024Feature Splatting: Language-Driven Physics-Based Scene Synthesis and Editingcited by 44
  28. 2020Fusion-Aware Point Convolution for Online Semantic 3D Scene Segmentationcited by 40
  29. 2024FastLGS: Speeding up Language Embedded Gaussians with Feature Grid Mappingcited by 34
  30. 2023SurfelNeRF: Neural Surfel Radiance Fields for Online Photorealistic Reconstruction of Indoor Scenescited by 30
  31. 2024Memory-based Adapters for Online 3D Scene Perceptioncited by 13
  32. 2024TIGER: Text-Instructed 3D Gaussian Retrieval and Coherent Editingcited by 10
  33. 2025ScenePainter: Semantically Consistent Perpetual 3D Scene Generation with Concept Relation Alignmentcited by 7
  34. 2023Anyview: Generalizable Indoor 3D Object Detection with Variable Framescited by 3

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.