LoGeR: Long-Context Geometric Reconstruction with Hybrid Memory
Not on the map. Why?
Abstract (arXiv)
Feedforward geometric foundation models achieve strong short-window reconstruction, yet scaling them to minutes-long videos is bottlenecked by quadratic attention complexity or limited effective memory in recurrent designs. We present LoGeR (Long-context Geometric Reconstruction), a novel architecture that scales dense 3D reconstruction to extremely long sequences without post-optimization. LoGeR processes video streams in chunks, leveraging strong bidirectional priors for high-fidelity intra-chunk reasoning. To manage the critical challenge of coherence across chunk boundaries, we propose a learning-based hybrid memory module. This dual-component system combines a parametric Test-Time Training (TTT) memory to anchor the global coordinate frame and prevent scale drift, alongside a non-parametric Sliding Window Attention (SWA) mechanism to preserve uncompressed context for high-precision adjacent alignment. Remarkably, this memory architecture enables LoGeR to be trained on sequences of 128 frames, and generalize up to thousands of frames during inference. Evaluated across standard benchmarks and a newly repurposed VBR dataset with sequences of up to 19k frames, LoGeR substantially outperforms prior state-of-the-art feedforward methods--reducing ATE on KITTI by over 74%--and achieves robust, globally consistent reconstruction over unprecedented horizons.
Key facts. Cited by 39 papers in the map (data through 14 Oct 2026). Builds on 49 of its 59 references that are in the map. First posted on arXiv 3 Mar 2026.
Builds on
49 of 59 references.
References · 49
- 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,718
- 2020Longformer: The Long-Document Transformercited by 3,413
- 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,117
- 2021Efficiently Modeling Long Sequences with Structured State Spacescited by 2,465
- 2020Transformers are RNNs: Fast Autoregressive Transformers with Linear Attentioncited by 2,022
- 2020Big Bird: Transformers for Longer Sequencescited by 1,684
- 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,567
- 2025VGGT: Visual Geometry Grounded Transformercited by 1,539
- 2015ORB-SLAM: a Versatile and Accurate Monocular SLAM Systemcited by 988
- 2024Grounding Image Matching in 3D with MASt3Rcited by 983
- 2016ORB-SLAM2: an Open-Source SLAM System for Monocular, Stereo and RGB-D Camerascited by 806
- 2023ScanNet++: A High-Fidelity Dataset of 3D Indoor Scenescited by 764
37 more
- 2018MegaDepth: Learning Single-View Depth Prediction from Internet Photoscited by 737
- 2021DROID-SLAM: Deep Visual SLAM for Monocular, Stereo, and RGB-D Camerascited by 687
- 2020Hypersim: A Photorealistic Synthetic Dataset for Holistic Indoor Scene Understandingcited by 604
- 2025Continuous 3D Perception Model with Persistent Statecited by 548
- 2023DL3DV-10K: A Large-Scale Scene Dataset for Deep Learning-based 3D Visioncited by 537
- 2020TartanAir: A Dataset to Push the Limits of Visual SLAMcited by 506
- 2021Linear Transformers Are Secretly Fast Weight Programmerscited by 502
- 2021ARKitScenes: A Diverse Real-World Dataset For 3D Indoor Scene Understanding Using Mobile RGB-D Datacited by 454
- 2024MonST3R: A Simple Approach for Estimating Geometry in the Presence of Motioncited by 442
- 2024Learning to (Learn at Test Time): RNNs with Expressive Hidden Statescited by 355
- 2020Virtual KITTI 2cited by 353
- 2025π3: Permutation-Equivariant Visual Geometry Learningcited by 319
- 2024MoGe: Unlocking Accurate Monocular Geometry Estimation for Open-Domain Images with Optimal Training Supervisioncited by 299
- 20243D Reconstruction with Spatial Memorycited by 277
- 2024MegaSaM: Accurate, Fast, and Robust Structure and Motion from Casual Dynamic Videoscited by 228
- 2024Flex Attention: A Programming Model for Generating Optimized Attention Kernelscited by 185
- 2019ReFusion: 3D Reconstruction in Dynamic Environments for RGB-D Cameras Exploiting Residualscited by 181
- 2023Spring: A High-Resolution High-Detail Dataset and Benchmark for Scene Flow, Optical Flow and Stereocited by 172
- 2025Streaming 4D Visual Geometry Transformercited by 161
- 2025VGGT-SLAM: Dense RGB SLAM Optimized on the SL(4) Manifoldcited by 136
- 2025Test-Time Training Done Rightcited by 130
- 2025TTT3R: 3D Reconstruction as Test-Time Trainingcited by 129
- 2025VGGT-Long: Chunk it, Loop it, Align it -- Pushing VGGT's Limits on Kilometer-scale Long RGB Sequencescited by 115
- 2025FastVGGT: Training-Free Acceleration of Visual Geometry Transformercited by 98
- 2025Point3R: Streaming 3D Reconstruction with Explicit Spatial Pointer Memorycited by 87
- 2025STream3R: Scalable Sequential 3D Reconstruction with Causal Transformercited by 82
- 2024Deep Patch Visual SLAMcited by 71
- 2025OmniWorld: A Multi-Domain and Multi-Modal Dataset for 4D World Modelingcited by 62
- 2026InfiniteVGGT: Visual Geometry Grounded Transformer for Endless Streamscited by 56
- 2025LONG3R: Long Sequence Streaming 3D Reconstructioncited by 45
- 2025TartanGround: A Large-Scale Dataset for Ground Robot Perception and Navigationcited by 36
- 2020Waymo Public Road Safety Performance Datacited by 24
- 2025Understanding and Improving Length Generalization in Recurrent Modelscited by 23
- 2026LongStream: Long-Sequence Streaming Autoregressive Visual Geometrycited by 23
- 2021Neural Disparity Refinement for Arbitrary Resolution Stereocited by 20
- 2026VGG-T3: Offline Feed-Forward 3D Reconstruction at Scalecited by 18
- 2024VBR: A Vision Benchmark in Romecited by 16
Built on by
Citing papers per year: 2026: 39.
39 papers.
Sort:
By area:
- 2026LingBot-Map: Geometric Context Transformer for Streaming 3D Reconstructioncited by 37
- 2026VGGT-Omegacited by 26
- 2026MemoryWAM: Efficient World Action Modeling with Persistent Memorycited by 13
- 2026HorizonStream: Long-Horizon Attention for Streaming 3D Reconstructioncited by 9
- 2026MeMix: Writing Less, Remembering More for Streaming 3D Reconstructioncited by 8
- 2026Mem3R: Streaming 3D Reconstruction with Hybrid Memory via Test-Time Trainingcited by 6
- 2026Feed-Forward 3D Scene Modeling: A Problem-Driven Perspectivecited by 6
- 2026Glob3R: Global Structure-from-Motion with 3D Foundation Modelscited by 4
- 2026OpenWorldLib: A Unified Codebase and Definition of Advanced World Modelscited by 3
- 2026Fast Spatial Memory with Elastic Test-Time Trainingcited by 3
- 2026Mamba-VGGT: Persistent Long-Sequence Video Geometry Grounded Transformer via External Sliding Window Mamba Memorycited by 3
- 2026R3: 3D Reconstruction via Relative Regressioncited by 2
27 more
- 2026G3T Up! Gravity Aligned Coordinate Frames Simplify Pointmap Processingcited by 2
- 2026Anchor3R: Streaming 3D Reconstruction with Transient Anchors for Long-Horizon Visual Mappingcited by 2
- 2026VidMap: Exploiting Temporal Structure for Video-Based Structure-from-Motioncited by 2
- 2026SS3D: End2End Self-Supervised 3D from Web Videoscited by 1
- 2026Rethinking the State Update Gate for Long-Sequence Recurrent 3D Reconstructioncited by 1
- 2026Compressing History into Memory: Distilling Transformers into Recurrent Transformerscited by 1
- 2026SAF3R: Dynamic Sparse Attention for Feed-Forward 3D Reconstruction Transformerscited by 1
- 2026Revisiting Local Context for Long-Horizon Streaming 3D Reconstructioncited by 1
- 2026GeoFF3D: Coordinate-Anchored Feed-Forward Reconstruction for Large-Scale UAV Mappingcited by 1
- 2026Point4D: Long-range 4D Motion Reconstructioncited by 1
- 2026Video DeltaNet: A Video-Native Hybrid Attention for Livestream Video Generationcited by 1
- 2026LongDPM: Overlap-Aware 4D Reconstruction from Long Monocular Videoscited by 0
- 2026Remember to be Curious: Episodic Context and Persistent Worlds for 3D Explorationcited by 0
- 2026Good Token Hunting: A Hitchhiker's Guide to Token Selection for Visual Geometry Transformerscited by 0
- 2026SpatialBench: Is Your Spatial Foundation Model an All-Round Player?cited by 0
- 2026Reasmory: 3D Reconstruction as Explicit Memory for VLMs Spatial Reasoningcited by 0
- 2026Online Neural Space Time Memory for Dynamic Novel View Synthesiscited by 0
- 2026VI3: Grounding Pretrained 3D Foundation Models with Inertial Cuescited by 0
- 2026SkyAnchor: Updating Metric-scale Aerial 3D Gaussian Scenes from Unposed Ground-View Sequencescited by 0
- 2026SURE-Map: Self-Correcting Streaming Geometric Foundation Modelscited by 0
- 2026AMB3R-SLAM: Kilometer-scale SLAM with Hierarchical Backendcited by 0
- 2026Adaptive World Memory 3D Foundation Model for Scalable 3D Mapping, Localization, and Renderingcited by 0
- 2026InfiniHand: Streaming World-Space Hand Motion Estimation from Egocentric Videocited by 0
- 2026CLoSeR: Closing the Loop for Long-Context Streaming Reconstructioncited by 0
- 2026Spatial Memory Intelligence: Endowing World Models with Understanding-Driven Long-Term Memorycited by 0
- 2026VGGT-Bridge: Beyond Sequential Pose Graphs via Coarse-Stride Skip Edgescited by 0
- 2026MIRAGE: Metric Inference and Reliability-Aware Gaussian Estimation from Feed-Forward Visioncited by 0
- 2026MIRAGE: Metric Inference and Reliability-Aware Gaussian Estimation from Feed-Forward Vision8 Oct 2026
- 2026VGGT-Bridge: Beyond Sequential Pose Graphs via Coarse-Stride Skip Edges5 Oct 2026
- 2026Spatial Memory Intelligence: Endowing World Models with Understanding-Driven Long-Term Memory1 Oct 2026
- 2026CLoSeR: Closing the Loop for Long-Context Streaming Reconstruction1 Oct 2026
- 2026InfiniHand: Streaming World-Space Hand Motion Estimation from Egocentric Video28 Sep 2026
- 2026Adaptive World Memory 3D Foundation Model for Scalable 3D Mapping, Localization, and Rendering18 Sep 2026
- 2026Video DeltaNet: A Video-Native Hybrid Attention for Livestream Video Generation17 Sep 2026
- 2026AMB3R-SLAM: Kilometer-scale SLAM with Hierarchical Backend17 Sep 2026
- 2026SURE-Map: Self-Correcting Streaming Geometric Foundation Models14 Sep 2026
- 2026SkyAnchor: Updating Metric-scale Aerial 3D Gaussian Scenes from Unposed Ground-View Sequences12 Sep 2026
- 2026Point4D: Long-range 4D Motion Reconstruction8 Sep 2026
- 2026VI3: Grounding Pretrained 3D Foundation Models with Inertial Cues3 Sep 2026
27 more
- 2026GeoFF3D: Coordinate-Anchored Feed-Forward Reconstruction for Large-Scale UAV Mapping28 Aug 2026
- 2026Revisiting Local Context for Long-Horizon Streaming 3D Reconstruction27 Aug 2026
- 2026VidMap: Exploiting Temporal Structure for Video-Based Structure-from-Motion29 Jul 2026
- 2026Online Neural Space Time Memory for Dynamic Novel View Synthesis16 Jul 2026
- 2026Glob3R: Global Structure-from-Motion with 3D Foundation Models10 Jul 2026
- 2026SAF3R: Dynamic Sparse Attention for Feed-Forward 3D Reconstruction Transformers3 Jul 2026
- 2026Compressing History into Memory: Distilling Transformers into Recurrent Transformers19 Jun 2026
- 2026MemoryWAM: Efficient World Action Modeling with Persistent Memory18 Jun 2026
- 2026Anchor3R: Streaming 3D Reconstruction with Transient Anchors for Long-Horizon Visual Mapping3 Jun 2026
- 2026Reasmory: 3D Reconstruction as Explicit Memory for VLMs Spatial Reasoning31 May 2026
- 2026G3T Up! Gravity Aligned Coordinate Frames Simplify Pointmap Processing26 May 2026
- 2026SpatialBench: Is Your Spatial Foundation Model an All-Round Player?26 May 2026
- 2026R3: 3D Reconstruction via Relative Regression26 May 2026
- 2026Good Token Hunting: A Hitchhiker's Guide to Token Selection for Visual Geometry Transformers22 May 2026
- 2026HorizonStream: Long-Horizon Attention for Streaming 3D Reconstruction22 May 2026
- 2026Remember to be Curious: Episodic Context and Persistent Worlds for 3D Exploration21 May 2026
- 2026Mamba-VGGT: Persistent Long-Sequence Video Geometry Grounded Transformer via External Sliding Window Mamba Memory17 May 2026
- 2026LongDPM: Overlap-Aware 4D Reconstruction from Long Monocular Videos17 May 2026
- 2026Rethinking the State Update Gate for Long-Sequence Recurrent 3D Reconstruction16 May 2026
- 2026VGGT-Omega14 May 2026
- 2026SS3D: End2End Self-Supervised 3D from Web Videos24 Apr 2026
- 2026LingBot-Map: Geometric Context Transformer for Streaming 3D Reconstruction15 Apr 2026
- 2026Feed-Forward 3D Scene Modeling: A Problem-Driven Perspective15 Apr 2026
- 2026Fast Spatial Memory with Elastic Test-Time Training8 Apr 2026
- 2026Mem3R: Streaming 3D Reconstruction with Hybrid Memory via Test-Time Training8 Apr 2026
- 2026OpenWorldLib: A Unified Codebase and Definition of Advanced World Models6 Apr 2026
- 2026MeMix: Writing Less, Remembering More for Streaming 3D Reconstruction16 Mar 2026
- 2026MemoryWAM: Efficient World Action Modeling with Persistent Memorycited by 13
- 2026Glob3R: Global Structure-from-Motion with 3D Foundation Modelscited by 4
- 2026OpenWorldLib: A Unified Codebase and Definition of Advanced World Modelscited by 3
- 2026Spatial Memory Intelligence: Endowing World Models with Understanding-Driven Long-Term Memorycited by 0
- 2026Spatial Memory Intelligence: Endowing World Models with Understanding-Driven Long-Term Memory1 Oct 2026
- 2026Glob3R: Global Structure-from-Motion with 3D Foundation Models10 Jul 2026
- 2026MemoryWAM: Efficient World Action Modeling with Persistent Memory18 Jun 2026
- 2026OpenWorldLib: A Unified Codebase and Definition of Advanced World Models6 Apr 2026
- 2026LingBot-Map: Geometric Context Transformer for Streaming 3D Reconstructioncited by 37
- 2026VGGT-Omegacited by 26
- 2026HorizonStream: Long-Horizon Attention for Streaming 3D Reconstructioncited by 9
- 2026MeMix: Writing Less, Remembering More for Streaming 3D Reconstructioncited by 8
- 2026Mem3R: Streaming 3D Reconstruction with Hybrid Memory via Test-Time Trainingcited by 6
- 2026Feed-Forward 3D Scene Modeling: A Problem-Driven Perspectivecited by 6
- 2026Fast Spatial Memory with Elastic Test-Time Trainingcited by 3
- 2026R3: 3D Reconstruction via Relative Regressioncited by 2
- 2026G3T Up! Gravity Aligned Coordinate Frames Simplify Pointmap Processingcited by 2
- 2026Anchor3R: Streaming 3D Reconstruction with Transient Anchors for Long-Horizon Visual Mappingcited by 2
- 2026VidMap: Exploiting Temporal Structure for Video-Based Structure-from-Motioncited by 2
- 2026SS3D: End2End Self-Supervised 3D from Web Videoscited by 1
12 most cited of 30 All 30 (JSON)
- 2026MIRAGE: Metric Inference and Reliability-Aware Gaussian Estimation from Feed-Forward Vision8 Oct 2026
- 2026VGGT-Bridge: Beyond Sequential Pose Graphs via Coarse-Stride Skip Edges5 Oct 2026
- 2026CLoSeR: Closing the Loop for Long-Context Streaming Reconstruction1 Oct 2026
- 2026InfiniHand: Streaming World-Space Hand Motion Estimation from Egocentric Video28 Sep 2026
- 2026AMB3R-SLAM: Kilometer-scale SLAM with Hierarchical Backend17 Sep 2026
- 2026SURE-Map: Self-Correcting Streaming Geometric Foundation Models14 Sep 2026
- 2026SkyAnchor: Updating Metric-scale Aerial 3D Gaussian Scenes from Unposed Ground-View Sequences12 Sep 2026
- 2026Point4D: Long-range 4D Motion Reconstruction8 Sep 2026
- 2026VI3: Grounding Pretrained 3D Foundation Models with Inertial Cues3 Sep 2026
- 2026GeoFF3D: Coordinate-Anchored Feed-Forward Reconstruction for Large-Scale UAV Mapping28 Aug 2026
- 2026Revisiting Local Context for Long-Horizon Streaming 3D Reconstruction27 Aug 2026
- 2026VidMap: Exploiting Temporal Structure for Video-Based Structure-from-Motion29 Jul 2026
12 newest of 30 All 30 (JSON)