LingBot-Map: Geometric Context Transformer for Streaming 3D Reconstruction
Not on the map. Why?
Abstract (arXiv)
Streaming 3D reconstruction aims to recover 3D information, such as camera poses and point clouds, from a video stream, which necessitates geometric accuracy, temporal consistency, and computational efficiency. Motivated by the principles of Simultaneous Localization and Mapping (SLAM), we introduce LingBot-Map, a feed-forward 3D foundation model for reconstructing scenes from streaming data, built upon a geometric context transformer (GCT) architecture. A defining aspect of LingBot-Map lies in its carefully designed attention mechanism, which integrates an anchor context, a pose-reference window, and a trajectory memory to address coordinate grounding, dense geometric cues, and long-range drift correction, respectively. This design keeps the streaming state compact while retaining rich geometric context, enabling stable efficient inference at around 20 FPS on 518 x 378 resolution inputs over long sequences exceeding 10,000 frames. Extensive evaluations across a variety of benchmarks demonstrate that our approach achieves superior performance compared to both existing streaming and iterative optimization-based approaches.
Key facts. Cited by 32 papers in the map (data through 7 Oct 2026). Builds on 88 of its 99 references that are in the map. First posted on arXiv 15 Apr 2026.
Builds on
88 of 99 references.
References · 88
- 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,767
- 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,088
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
- 2019Scalability in Perception for Autonomous Driving: Waymo Open Datasetcited by 2,436
- 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,526
- 2022Objaverse: A Universe of Annotated 3D Objectscited by 1,522
- 2025VGGT: Visual Geometry Grounded Transformercited by 1,475
- 2019SuperGlue: Learning Feature Matching with Graph Neural Networkscited by 1,437
- 2017Matterport3D: Learning from RGB-D Data in Indoor Environmentscited by 1,354
- 2017SuperPoint: Self-Supervised Interest Point Detection and Descriptioncited by 1,313
- 2019Habitat: A Platform for Embodied AI Researchcited by 1,163
- 2015ORB-SLAM: a Versatile and Accurate Monocular SLAM Systemcited by 983
38 more
- 2021LoFTR: Detector-Free Local Feature Matching with Transformerscited by 974
- 2020ORB-SLAM3: An Accurate Open-Source Library for Visual, Visual-Inertial and Multi-Map SLAMcited by 862
- 2023LRM: Large Reconstruction Model for Single Image to 3Dcited by 834
- 2016ORB-SLAM2: an Open-Source SLAM System for Monocular, Stereo and RGB-D Camerascited by 801
- 2018MVSNet: Depth Inference for Unstructured Multi-view Stereocited by 780
- 2023ScanNet++: A High-Fidelity Dataset of 3D Indoor Scenescited by 747
- 2018MegaDepth: Learning Single-View Depth Prediction from Internet Photoscited by 731
- 2024LGM: Large Multi-View Gaussian Model for High-Resolution 3D Content Creationcited by 730
- 2021DROID-SLAM: Deep Visual SLAM for Monocular, Stereo, and RGB-D Camerascited by 673
- 2021Common Objects in 3D: Large-Scale Learning and Evaluation of Real-life 3D Category Reconstructioncited by 646
- 2025Depth Anything 3: Recovering the Visual Space from Any Viewscited by 626
- 2020Hypersim: A Photorealistic Synthetic Dataset for Holistic Indoor Scene Understandingcited by 593
- 2021Habitat-Matterport 3D Dataset (HM3D): 1000 Large-scale 3D Environments for Embodied AIcited by 579
- 2021KITTI-360: A Novel Dataset and Benchmarks for Urban Scene Understanding in 2D and 3Dcited by 570
- 2025Continuous 3D Perception Model with Persistent Statecited by 527
- 2023DL3DV-10K: A Large-Scale Scene Dataset for Deep Learning-based 3D Visioncited by 514
- 2020TartanAir: A Dataset to Push the Limits of Visual SLAMcited by 494
- 2019BlendedMVS: A Large-scale Dataset for Generalized Multi-view Stereo Networkscited by 487
- 2018Gibson Env: Real-World Perception for Embodied Agentscited by 477
- 2024MonST3R: A Simple Approach for Estimating Geometry in the Presence of Motioncited by 431
- 2023Instant3D: Fast Text-to-3D with Sparse-View Generation and Large Reconstruction Modelcited by 376
- 2022Kubric: A scalable dataset generatorcited by 373
- 2025Fast3R: Towards 3D Reconstruction of 1000+ Images in One Forward Passcited by 356
- 2020Virtual KITTI 2cited by 345
- 2021Neural RGB-D Surface Reconstructioncited by 312
- 2024GRM: Large Gaussian Reconstruction Model for Efficient 3D Reconstruction and Generationcited by 298
- 2025MapAnything: Universal Feed-Forward Metric 3D Reconstructioncited by 295
- 2025π3: Permutation-Equivariant Visual Geometry Learningcited by 292
- 2018DeepMVS: Learning Multi-view Stereopsiscited by 277
- 2023PointOdyssey: A Large-Scale Synthetic Dataset for Long-Term Point Trackingcited by 274
- 20243D Reconstruction with Spatial Memorycited by 269
- 2019Recurrent MVSNet for High-resolution Multi-view Stereo Depth Inferencecited by 252
- 2025FlashInfer: Efficient and Customizable Attention Engine for LLM Inference Servingcited by 248
- 2024No Pose, No Problem: Surprisingly Simple 3D Gaussian Splats from Sparse Unposed Imagescited by 241
- 2023DeepSpeed Ulysses: System Optimizations for Enabling Training of Extreme Long Sequence Transformer Modelscited by 239
- 2025AnySplat: Feed-forward 3D Gaussian Splatting from Unconstrained Viewscited by 234
- 2023Visual Geometry Grounded Deep Structure From Motioncited by 225
- 2024MegaSaM: Accurate, Fast, and Robust Structure and Motion from Casual Dynamic Videoscited by 224
50 most cited of 88 All 88 (JSON)
Built on by
Citing papers per year: 2026: 32.
32 papers.
Sort:
By area:
- 2026VGGT-Omegacited by 20
- 2026MemoryWAM: Efficient World Action Modeling with Persistent Memorycited by 12
- 2026HorizonStream: Long-Horizon Attention for Streaming 3D Reconstructioncited by 8
- 2026Nano World Models: A Minimalist Implementation of Future Video Predictioncited by 4
- 2026Mamba-VGGT: Persistent Long-Sequence Video Geometry Grounded Transformer via External Sliding Window Mamba Memorycited by 3
- 2026R3: 3D Reconstruction via Relative Regressioncited by 2
- 2026Glob3R: Global Structure-from-Motion with 3D Foundation Modelscited by 2
- 2026IGGT4D: Streaming 4D Instance-Grounded Geometry Transformercited by 2
- 2026VidMap: Exploiting Temporal Structure for Video-Based Structure-from-Motioncited by 2
- 2026MINT: A Unified Model for World-Space Camera and Hand Motion Estimation from Scalable Egocentric Pipeline Supervisioncited by 2
- 2026G2G: Exploiting Intra-Group Geometry for Inter-Group Pose Estimationcited by 1
- 2026QuerySplat: Decoupling Geometry and Appearance Representations in 3DGS Predictioncited by 1
20 more
- 2026SLAMFormer-∞: Infinite SLAM Transformer for Unbounded Frontend and Backend Processingcited by 1
- 2026GeoFF3D: Coordinate-Anchored Feed-Forward Reconstruction for Large-Scale UAV Mappingcited by 1
- 2026Oneira: From Open-Ended Generation to Open-World Interaction in Video World Modelscited by 1
- 2026NavOne: One-Step Global Planning for Vision-Language Navigation on Top-Down Mapscited by 0
- 2026LongDPM: Overlap-Aware 4D Reconstruction from Long Monocular Videoscited by 0
- 2026Good Token Hunting: A Hitchhiker's Guide to Token Selection for Visual Geometry Transformerscited by 0
- 2026SAF3R: Dynamic Sparse Attention for Feed-Forward 3D Reconstruction Transformerscited by 0
- 2026TRIG: Trajectory-Rig Decoupled Metric Geometry Learningcited by 0
- 2026Context by Distinct Information: An Auditable Dirichlet-Process Working Memory for Long, Redundant Context Streamscited by 0
- 2026GeoWeaver: Accurate Long-Sequence 3D Reconstruction via Hierarchical Geometric Assemblycited by 0
- 2026Revisiting Local Context for Long-Horizon Streaming 3D Reconstructioncited by 0
- 2026On-the-Fly3R: Towards Robust Online 3D Reconstruction with Feed-Forward 3R Models for Large-Scale UAV Scenarioscited by 0
- 2026FFVO: A Feedforward Pose Decoder for Long-Horizon Visual Odometrycited by 0
- 2026SURE-Map: Self-Correcting Streaming Geometric Foundation Modelscited by 0
- 2026World SLAM Model: Joint World Modeling for SLAM and Navigationcited by 0
- 2026InfiniHand: Streaming World-Space Hand Motion Estimation from Egocentric Videocited by 0
- 2026StreamRig: Exploiting Intra-Rig Geometry for Streaming Multi-Camera Odometrycited by 0
- 2026EgoFound3R: End-to-End Egocentric Hand Reconstruction in World Space with Point-Wise Interaction Attributescited by 0
- 2026CLoSeR: Closing the Loop for Long-Context Streaming Reconstructioncited by 0
- 2026Slot3R: Set-Associative Spatial Memory for Streaming 3D Reconstructioncited by 0
- 2026Slot3R: Set-Associative Spatial Memory for Streaming 3D Reconstruction8 Oct 2026
- 2026CLoSeR: Closing the Loop for Long-Context Streaming Reconstruction1 Oct 2026
- 2026Oneira: From Open-Ended Generation to Open-World Interaction in Video World Models1 Oct 2026
- 2026EgoFound3R: End-to-End Egocentric Hand Reconstruction in World Space with Point-Wise Interaction Attributes1 Oct 2026
- 2026StreamRig: Exploiting Intra-Rig Geometry for Streaming Multi-Camera Odometry30 Sep 2026
- 2026InfiniHand: Streaming World-Space Hand Motion Estimation from Egocentric Video28 Sep 2026
- 2026World SLAM Model: Joint World Modeling for SLAM and Navigation26 Sep 2026
- 2026SURE-Map: Self-Correcting Streaming Geometric Foundation Models14 Sep 2026
- 2026FFVO: A Feedforward Pose Decoder for Long-Horizon Visual Odometry12 Sep 2026
- 2026MINT: A Unified Model for World-Space Camera and Hand Motion Estimation from Scalable Egocentric Pipeline Supervision4 Sep 2026
- 2026On-the-Fly3R: Towards Robust Online 3D Reconstruction with Feed-Forward 3R Models for Large-Scale UAV Scenarios1 Sep 2026
- 2026GeoFF3D: Coordinate-Anchored Feed-Forward Reconstruction for Large-Scale UAV Mapping28 Aug 2026
20 more
- 2026Revisiting Local Context for Long-Horizon Streaming 3D Reconstruction27 Aug 2026
- 2026GeoWeaver: Accurate Long-Sequence 3D Reconstruction via Hierarchical Geometric Assembly18 Aug 2026
- 2026SLAMFormer-∞: Infinite SLAM Transformer for Unbounded Frontend and Backend Processing4 Aug 2026
- 2026QuerySplat: Decoupling Geometry and Appearance Representations in 3DGS Prediction2 Aug 2026
- 2026VidMap: Exploiting Temporal Structure for Video-Based Structure-from-Motion29 Jul 2026
- 2026IGGT4D: Streaming 4D Instance-Grounded Geometry Transformer21 Jul 2026
- 2026Context by Distinct Information: An Auditable Dirichlet-Process Working Memory for Long, Redundant Context Streams11 Jul 2026
- 2026Glob3R: Global Structure-from-Motion with 3D Foundation Models10 Jul 2026
- 2026TRIG: Trajectory-Rig Decoupled Metric Geometry Learning7 Jul 2026
- 2026SAF3R: Dynamic Sparse Attention for Feed-Forward 3D Reconstruction Transformers3 Jul 2026
- 2026MemoryWAM: Efficient World Action Modeling with Persistent Memory18 Jun 2026
- 2026G2G: Exploiting Intra-Group Geometry for Inter-Group Pose Estimation6 Jun 2026
- 2026R3: 3D Reconstruction via Relative Regression26 May 2026
- 2026Good Token Hunting: A Hitchhiker's Guide to Token Selection for Visual Geometry Transformers22 May 2026
- 2026HorizonStream: Long-Horizon Attention for Streaming 3D Reconstruction22 May 2026
- 2026Nano World Models: A Minimalist Implementation of Future Video Prediction17 May 2026
- 2026Mamba-VGGT: Persistent Long-Sequence Video Geometry Grounded Transformer via External Sliding Window Mamba Memory17 May 2026
- 2026LongDPM: Overlap-Aware 4D Reconstruction from Long Monocular Videos17 May 2026
- 2026VGGT-Omega14 May 2026
- 2026NavOne: One-Step Global Planning for Vision-Language Navigation on Top-Down Maps7 May 2026
- 2026MemoryWAM: Efficient World Action Modeling with Persistent Memorycited by 12
- 2026Nano World Models: A Minimalist Implementation of Future Video Predictioncited by 4
- 2026Glob3R: Global Structure-from-Motion with 3D Foundation Modelscited by 2
- 2026Oneira: From Open-Ended Generation to Open-World Interaction in Video World Modelscited by 1
- 2026World SLAM Model: Joint World Modeling for SLAM and Navigationcited by 0
- 2026Oneira: From Open-Ended Generation to Open-World Interaction in Video World Models1 Oct 2026
- 2026World SLAM Model: Joint World Modeling for SLAM and Navigation26 Sep 2026
- 2026Glob3R: Global Structure-from-Motion with 3D Foundation Models10 Jul 2026
- 2026MemoryWAM: Efficient World Action Modeling with Persistent Memory18 Jun 2026
- 2026Nano World Models: A Minimalist Implementation of Future Video Prediction17 May 2026
- 2026VGGT-Omegacited by 20
- 2026HorizonStream: Long-Horizon Attention for Streaming 3D Reconstructioncited by 8
- 2026R3: 3D Reconstruction via Relative Regressioncited by 2
- 2026IGGT4D: Streaming 4D Instance-Grounded Geometry Transformercited by 2
- 2026VidMap: Exploiting Temporal Structure for Video-Based Structure-from-Motioncited by 2
- 2026MINT: A Unified Model for World-Space Camera and Hand Motion Estimation from Scalable Egocentric Pipeline Supervisioncited by 2
- 2026G2G: Exploiting Intra-Group Geometry for Inter-Group Pose Estimationcited by 1
- 2026QuerySplat: Decoupling Geometry and Appearance Representations in 3DGS Predictioncited by 1
- 2026SLAMFormer-∞: Infinite SLAM Transformer for Unbounded Frontend and Backend Processingcited by 1
- 2026GeoFF3D: Coordinate-Anchored Feed-Forward Reconstruction for Large-Scale UAV Mappingcited by 1
- 2026NavOne: One-Step Global Planning for Vision-Language Navigation on Top-Down Mapscited by 0
- 2026LongDPM: Overlap-Aware 4D Reconstruction from Long Monocular Videoscited by 0
12 most cited of 26 All 26 (JSON)
- 2026Slot3R: Set-Associative Spatial Memory for Streaming 3D Reconstruction8 Oct 2026
- 2026CLoSeR: Closing the Loop for Long-Context Streaming Reconstruction1 Oct 2026
- 2026EgoFound3R: End-to-End Egocentric Hand Reconstruction in World Space with Point-Wise Interaction Attributes1 Oct 2026
- 2026StreamRig: Exploiting Intra-Rig Geometry for Streaming Multi-Camera Odometry30 Sep 2026
- 2026InfiniHand: Streaming World-Space Hand Motion Estimation from Egocentric Video28 Sep 2026
- 2026SURE-Map: Self-Correcting Streaming Geometric Foundation Models14 Sep 2026
- 2026FFVO: A Feedforward Pose Decoder for Long-Horizon Visual Odometry12 Sep 2026
- 2026MINT: A Unified Model for World-Space Camera and Hand Motion Estimation from Scalable Egocentric Pipeline Supervision4 Sep 2026
- 2026On-the-Fly3R: Towards Robust Online 3D Reconstruction with Feed-Forward 3R Models for Large-Scale UAV Scenarios1 Sep 2026
- 2026GeoFF3D: Coordinate-Anchored Feed-Forward Reconstruction for Large-Scale UAV Mapping28 Aug 2026
- 2026Revisiting Local Context for Long-Horizon Streaming 3D Reconstruction27 Aug 2026
- 2026GeoWeaver: Accurate Long-Sequence 3D Reconstruction via Hierarchical Geometric Assembly18 Aug 2026
12 newest of 26 All 26 (JSON)