mlsanityData to 14 Oct 2026

LoGeR: Long-Context Geometric Reconstruction with Hybrid Memory

arXiv 2603.03269 ↗First posted 3 Mar 2026cs.CV cs.LGcited by 39

Not on the map. Why?

Abstract (arXiv)

Feedforward geometric foundation models achieve strong short-window reconstruction, yet scaling them to minutes-long videos is bottlenecked by quadratic attention complexity or limited effective memory in recurrent designs. We present LoGeR (Long-context Geometric Reconstruction), a novel architecture that scales dense 3D reconstruction to extremely long sequences without post-optimization. LoGeR processes video streams in chunks, leveraging strong bidirectional priors for high-fidelity intra-chunk reasoning. To manage the critical challenge of coherence across chunk boundaries, we propose a learning-based hybrid memory module. This dual-component system combines a parametric Test-Time Training (TTT) memory to anchor the global coordinate frame and prevent scale drift, alongside a non-parametric Sliding Window Attention (SWA) mechanism to preserve uncompressed context for high-precision adjacent alignment. Remarkably, this memory architecture enables LoGeR to be trained on sequences of 128 frames, and generalize up to thousands of frames during inference. Evaluated across standard benchmarks and a newly repurposed VBR dataset with sequences of up to 19k frames, LoGeR substantially outperforms prior state-of-the-art feedforward methods--reducing ATE on KITTI by over 74%--and achieves robust, globally consistent reconstruction over unprecedented horizons.

Key facts. Cited by 39 papers in the map (data through 14 Oct 2026). Builds on 49 of its 59 references that are in the map. First posted on arXiv 3 Mar 2026.

Builds on

49 of 59 references.

References · 49

  1. 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,718
  2. 2020Longformer: The Long-Document Transformercited by 3,413
  3. 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,117
  4. 2021Efficiently Modeling Long Sequences with Structured State Spacescited by 2,465
  5. 2020Transformers are RNNs: Fast Autoregressive Transformers with Linear Attentioncited by 2,022
  6. 2020Big Bird: Transformers for Longer Sequencescited by 1,684
  7. 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,567
  8. 2025VGGT: Visual Geometry Grounded Transformercited by 1,539
  9. 2015ORB-SLAM: a Versatile and Accurate Monocular SLAM Systemcited by 988
  10. 2024Grounding Image Matching in 3D with MASt3Rcited by 983
  11. 2016ORB-SLAM2: an Open-Source SLAM System for Monocular, Stereo and RGB-D Camerascited by 806
  12. 2023ScanNet++: A High-Fidelity Dataset of 3D Indoor Scenescited by 764
37 more
  1. 2018MegaDepth: Learning Single-View Depth Prediction from Internet Photoscited by 737
  2. 2021DROID-SLAM: Deep Visual SLAM for Monocular, Stereo, and RGB-D Camerascited by 687
  3. 2020Hypersim: A Photorealistic Synthetic Dataset for Holistic Indoor Scene Understandingcited by 604
  4. 2025Continuous 3D Perception Model with Persistent Statecited by 548
  5. 2023DL3DV-10K: A Large-Scale Scene Dataset for Deep Learning-based 3D Visioncited by 537
  6. 2020TartanAir: A Dataset to Push the Limits of Visual SLAMcited by 506
  7. 2021Linear Transformers Are Secretly Fast Weight Programmerscited by 502
  8. 2021ARKitScenes: A Diverse Real-World Dataset For 3D Indoor Scene Understanding Using Mobile RGB-D Datacited by 454
  9. 2024MonST3R: A Simple Approach for Estimating Geometry in the Presence of Motioncited by 442
  10. 2024Learning to (Learn at Test Time): RNNs with Expressive Hidden Statescited by 355
  11. 2020Virtual KITTI 2cited by 353
  12. 2025π3: Permutation-Equivariant Visual Geometry Learningcited by 319
  13. 2024MoGe: Unlocking Accurate Monocular Geometry Estimation for Open-Domain Images with Optimal Training Supervisioncited by 299
  14. 20243D Reconstruction with Spatial Memorycited by 277
  15. 2024MegaSaM: Accurate, Fast, and Robust Structure and Motion from Casual Dynamic Videoscited by 228
  16. 2024Flex Attention: A Programming Model for Generating Optimized Attention Kernelscited by 185
  17. 2019ReFusion: 3D Reconstruction in Dynamic Environments for RGB-D Cameras Exploiting Residualscited by 181
  18. 2023Spring: A High-Resolution High-Detail Dataset and Benchmark for Scene Flow, Optical Flow and Stereocited by 172
  19. 2025Streaming 4D Visual Geometry Transformercited by 161
  20. 2025VGGT-SLAM: Dense RGB SLAM Optimized on the SL(4) Manifoldcited by 136
  21. 2025Test-Time Training Done Rightcited by 130
  22. 2025TTT3R: 3D Reconstruction as Test-Time Trainingcited by 129
  23. 2025VGGT-Long: Chunk it, Loop it, Align it -- Pushing VGGT's Limits on Kilometer-scale Long RGB Sequencescited by 115
  24. 2025FastVGGT: Training-Free Acceleration of Visual Geometry Transformercited by 98
  25. 2025Point3R: Streaming 3D Reconstruction with Explicit Spatial Pointer Memorycited by 87
  26. 2025STream3R: Scalable Sequential 3D Reconstruction with Causal Transformercited by 82
  27. 2024Deep Patch Visual SLAMcited by 71
  28. 2025OmniWorld: A Multi-Domain and Multi-Modal Dataset for 4D World Modelingcited by 62
  29. 2026InfiniteVGGT: Visual Geometry Grounded Transformer for Endless Streamscited by 56
  30. 2025LONG3R: Long Sequence Streaming 3D Reconstructioncited by 45
  31. 2025TartanGround: A Large-Scale Dataset for Ground Robot Perception and Navigationcited by 36
  32. 2020Waymo Public Road Safety Performance Datacited by 24
  33. 2025Understanding and Improving Length Generalization in Recurrent Modelscited by 23
  34. 2026LongStream: Long-Sequence Streaming Autoregressive Visual Geometrycited by 23
  35. 2021Neural Disparity Refinement for Arbitrary Resolution Stereocited by 20
  36. 2026VGG-T3: Offline Feed-Forward 3D Reconstruction at Scalecited by 18
  37. 2024VBR: A Vision Benchmark in Romecited by 16

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 39.

39 papers.

Sort:

By area:

  1. 2026LingBot-Map: Geometric Context Transformer for Streaming 3D Reconstructioncited by 37
  2. 2026VGGT-Omegacited by 26
  3. 2026MemoryWAM: Efficient World Action Modeling with Persistent Memorycited by 13
  4. 2026HorizonStream: Long-Horizon Attention for Streaming 3D Reconstructioncited by 9
  5. 2026MeMix: Writing Less, Remembering More for Streaming 3D Reconstructioncited by 8
  6. 2026Mem3R: Streaming 3D Reconstruction with Hybrid Memory via Test-Time Trainingcited by 6
  7. 2026Feed-Forward 3D Scene Modeling: A Problem-Driven Perspectivecited by 6
  8. 2026Glob3R: Global Structure-from-Motion with 3D Foundation Modelscited by 4
  9. 2026OpenWorldLib: A Unified Codebase and Definition of Advanced World Modelscited by 3
  10. 2026Fast Spatial Memory with Elastic Test-Time Trainingcited by 3
  11. 2026Mamba-VGGT: Persistent Long-Sequence Video Geometry Grounded Transformer via External Sliding Window Mamba Memorycited by 3
  12. 2026R3: 3D Reconstruction via Relative Regressioncited by 2
27 more
  1. 2026G3T Up! Gravity Aligned Coordinate Frames Simplify Pointmap Processingcited by 2
  2. 2026Anchor3R: Streaming 3D Reconstruction with Transient Anchors for Long-Horizon Visual Mappingcited by 2
  3. 2026VidMap: Exploiting Temporal Structure for Video-Based Structure-from-Motioncited by 2
  4. 2026SS3D: End2End Self-Supervised 3D from Web Videoscited by 1
  5. 2026Rethinking the State Update Gate for Long-Sequence Recurrent 3D Reconstructioncited by 1
  6. 2026Compressing History into Memory: Distilling Transformers into Recurrent Transformerscited by 1
  7. 2026SAF3R: Dynamic Sparse Attention for Feed-Forward 3D Reconstruction Transformerscited by 1
  8. 2026Revisiting Local Context for Long-Horizon Streaming 3D Reconstructioncited by 1
  9. 2026GeoFF3D: Coordinate-Anchored Feed-Forward Reconstruction for Large-Scale UAV Mappingcited by 1
  10. 2026Point4D: Long-range 4D Motion Reconstructioncited by 1
  11. 2026Video DeltaNet: A Video-Native Hybrid Attention for Livestream Video Generationcited by 1
  12. 2026LongDPM: Overlap-Aware 4D Reconstruction from Long Monocular Videoscited by 0
  13. 2026Remember to be Curious: Episodic Context and Persistent Worlds for 3D Explorationcited by 0
  14. 2026Good Token Hunting: A Hitchhiker's Guide to Token Selection for Visual Geometry Transformerscited by 0
  15. 2026SpatialBench: Is Your Spatial Foundation Model an All-Round Player?cited by 0
  16. 2026Reasmory: 3D Reconstruction as Explicit Memory for VLMs Spatial Reasoningcited by 0
  17. 2026Online Neural Space Time Memory for Dynamic Novel View Synthesiscited by 0
  18. 2026VI3: Grounding Pretrained 3D Foundation Models with Inertial Cuescited by 0
  19. 2026SkyAnchor: Updating Metric-scale Aerial 3D Gaussian Scenes from Unposed Ground-View Sequencescited by 0
  20. 2026SURE-Map: Self-Correcting Streaming Geometric Foundation Modelscited by 0
  21. 2026AMB3R-SLAM: Kilometer-scale SLAM with Hierarchical Backendcited by 0
  22. 2026Adaptive World Memory 3D Foundation Model for Scalable 3D Mapping, Localization, and Renderingcited by 0
  23. 2026InfiniHand: Streaming World-Space Hand Motion Estimation from Egocentric Videocited by 0
  24. 2026CLoSeR: Closing the Loop for Long-Context Streaming Reconstructioncited by 0
  25. 2026Spatial Memory Intelligence: Endowing World Models with Understanding-Driven Long-Term Memorycited by 0
  26. 2026VGGT-Bridge: Beyond Sequential Pose Graphs via Coarse-Stride Skip Edgescited by 0
  27. 2026MIRAGE: Metric Inference and Reliability-Aware Gaussian Estimation from Feed-Forward Visioncited by 0