TTSA3R: Training-Free Temporal-Spatial Adaptive Persistent State for Streaming 3D Reconstruction
Not on the map. Why?
Abstract (arXiv)
Streaming recurrent models enable efficient 3D reconstruction by maintaining persistent state representations. However, they suffer from catastrophic forgetting over long sequences due to balancing historical information with new observations. Recent methods alleviate this by deriving adaptive signals from the attention perspective, but they operate on single dimensions without considering temporal and spatial consistency. To this end, we propose a training-free framework termed TTSA3R that leverages both temporal state evolution and spatial observation quality for adaptive state updates in 3D reconstruction. In particular, we devise a Temporal Adaptive Update Module that regulates update magnitude by analyzing temporal state evolution patterns. Then, a Spatial Contextual Update Module is introduced to localize spatial regions that require updates through observation-state alignment and scene dynamics. These complementary signals are finally fused to determine the state updating strategies. Extensive experiments show that TTSA3R achieves competitive performance on standard short-sequence benchmarks and provides substantially stronger robustness on extended sequences. On NRGBD, as sequences extend from 50 to 250 frames, TTSA3R exhibits only a 1.33x error increase, compared with over 4x degradation for CUT3R. This highlights the practical value of temporal-spatial adaptive updates for long-term reconstruction stability. Our code is available at https://github.com/anonus2357/ttsa3r.
Key facts. Cited by 10 papers in the map (data through 7 Oct 2026). Builds on 40 of its 61 references that are in the map. First posted on arXiv 30 Jan 2026.
Builds on
40 of 61 references.
References · 40
- 2017Attention Is All You Needcited by 59,932
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
- 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,088
- 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,526
- 2025VGGT: Visual Geometry Grounded Transformercited by 1,475
- 2024Grounding Image Matching in 3D with MASt3Rcited by 960
- 2023pixelSplat: 3D Gaussian Splats from Image Pairs for Scalable Generalizable 3D Reconstructioncited by 668
- 2025Continuous 3D Perception Model with Persistent Statecited by 527
- 2024MonST3R: A Simple Approach for Estimating Geometry in the Presence of Motioncited by 431
- 2016Past, Present, and Future of Simultaneous Localization And Mapping: Towards the Robust-Perception Agecited by 405
- 2025Fast3R: Towards 3D Reconstruction of 1000+ Images in One Forward Passcited by 356
28 more
- 2024GS-LRM: Large Reconstruction Model for 3D Gaussian Splattingcited by 344
- 2023ReconFusion: 3D Reconstruction with Diffusion Priorscited by 317
- 2021Neural RGB-D Surface Reconstructioncited by 312
- 20243D Reconstruction with Spatial Memorycited by 269
- 2021Pixel-Perfect Structure-from-Motion with Featuremetric Refinementcited by 199
- 2020Robust Consistent Video Depth Estimationcited by 188
- 2019ReFusion: 3D Reconstruction in Dynamic Environments for RGB-D Cameras Exploiting Residualscited by 180
- 2023Single-Stage Diffusion NeRF: A Unified Approach to 3D Generation and Reconstructioncited by 180
- 2022CroCo: Self-Supervised Pre-training for 3D Vision Tasks by Cross-View Completioncited by 158
- 2019Point-Based Multi-View Stereo Networkcited by 147
- 2025Streaming 4D Visual Geometry Transformercited by 147
- 2023Photo-SLAM: Real-time Simultaneous Localization and Photorealistic Mapping for Monocular, Stereo, and RGB-D Camerascited by 139
- 2025TTT3R: 3D Reconstruction as Test-Time Trainingcited by 122
- 2025FastVGGT: Training-Free Acceleration of Visual Geometry Transformercited by 93
- 2025Easi3R: Estimating Disentangled Motion from DUSt3R Without Trainingcited by 88
- 2025Point3R: Streaming 3D Reconstruction with Explicit Spatial Pointer Memorycited by 82
- 2025STream3R: Scalable Sequential 3D Reconstruction with Causal Transformercited by 76
- 2025LONG3R: Long Sequence Streaming 3D Reconstructioncited by 45
- 2025Human3R: Everyone Everywhere All at Oncecited by 35
- 2025WinT3R: Window-Based Streaming Reconstruction with Camera Token Poolcited by 32
- 2024GaussianRoom: Improving 3D Gaussian Splatting with SDF Guidance and Monocular Cues for Indoor Scene Reconstructioncited by 31
- 2024Robust Incremental Structure-from-Motion with Hybrid Featurescited by 31
- 2025DroneSplat: 3D Gaussian Splatting for Robust 3D Reconstruction from In-the-Wild Drone Imagerycited by 20
- 2025Test3R: Learning to Reconstruct 3D at Test Timecited by 19
- 2025Robust and Efficient 3D Gaussian Splatting for Urban Scene Reconstructioncited by 7
- 2025MUT3R: Motion-aware Updating Transformer for Dynamic 3D Reconstructioncited by 7
- 2025SAB3R: Semantic-Augmented Backbone in 3D Reconstructioncited by 6
- 2024SUP-NeRF: A Streamlined Unification of Pose Estimation and NeRF for Monocular 3D Object Reconstructioncited by 3
Built on by
Citing papers per year: 2026: 10.
10 papers.
- 2026MeMix: Writing Less, Remembering More for Streaming 3D Reconstructioncited by 5
- 2026Mem3R: Streaming 3D Reconstruction with Hybrid Memory via Test-Time Trainingcited by 5
- 2026FILT3R: Latent State Adaptive Kalman Filter for Streaming 3D Reconstructioncited by 3
- 2026Attention Itself Could Retrieve.RetrieveVGGT: Training-Free Long Context Streaming 3D Reconstruction via Query-Key Similarity Retrievalcited by 3
- 2026Rethinking the State Update Gate for Long-Sequence Recurrent 3D Reconstructioncited by 1
- 2026Good Token Hunting: A Hitchhiker's Guide to Token Selection for Visual Geometry Transformerscited by 0
- 2026Graph Sparse Sampling: Breaking the Curse of the Horizon in Continuous MDP Planningcited by 0
- 2026Scal3R: Learning Efficient Multi-Relative Pose Query for Scalable Online 3D Reconstructioncited by 0
- 2026Adaptive World Memory 3D Foundation Model for Scalable 3D Mapping, Localization, and Renderingcited by 0
- 2026Dyna3: VLM-Guided Training-Free 4D Reconstruction via Depth Foundation Modelscited by 0
- 2026Dyna3: VLM-Guided Training-Free 4D Reconstruction via Depth Foundation Models1 Oct 2026
- 2026Adaptive World Memory 3D Foundation Model for Scalable 3D Mapping, Localization, and Rendering18 Sep 2026
- 2026Scal3R: Learning Efficient Multi-Relative Pose Query for Scalable Online 3D Reconstruction3 Sep 2026
- 2026Graph Sparse Sampling: Breaking the Curse of the Horizon in Continuous MDP Planning6 Jul 2026
- 2026Good Token Hunting: A Hitchhiker's Guide to Token Selection for Visual Geometry Transformers22 May 2026
- 2026Rethinking the State Update Gate for Long-Sequence Recurrent 3D Reconstruction16 May 2026
- 2026Attention Itself Could Retrieve.RetrieveVGGT: Training-Free Long Context Streaming 3D Reconstruction via Query-Key Similarity Retrieval10 May 2026
- 2026Mem3R: Streaming 3D Reconstruction with Hybrid Memory via Test-Time Training8 Apr 2026
- 2026FILT3R: Latent State Adaptive Kalman Filter for Streaming 3D Reconstruction19 Mar 2026
- 2026MeMix: Writing Less, Remembering More for Streaming 3D Reconstruction16 Mar 2026