WinT3R: Window-Based Streaming Reconstruction with Camera Token Pool
Not on the map. Why?
Abstract (arXiv)
We present WinT3R, a feed-forward reconstruction model capable of online prediction of precise camera poses and high-quality point maps. Previous methods suffer from a trade-off between reconstruction quality and real-time performance. To address this, we first introduce a sliding window mechanism that ensures sufficient information exchange among frames within the window, thereby improving the quality of geometric predictions without large computation. In addition, we leverage a compact representation of cameras and maintain a global camera token pool, which enhances the reliability of camera pose estimation without sacrificing efficiency. These designs enable WinT3R to achieve state-of-the-art performance in terms of online reconstruction quality, camera pose estimation, and reconstruction speed, as validated by extensive experiments on diverse datasets. Code and model are publicly available at https://github.com/LiZizun/WinT3R.
Key facts. Cited by 35 papers in the map (data through 14 Oct 2026). Builds on 47 of its 73 references that are in the map. First posted on arXiv 5 Sep 2025.
Builds on
47 of 73 references.
References · 47
- 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,117
- 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,567
- 2025VGGT: Visual Geometry Grounded Transformercited by 1,539
- 2019SuperGlue: Learning Feature Matching with Graph Neural Networkscited by 1,443
- 2017SuperPoint: Self-Supervised Interest Point Detection and Descriptioncited by 1,320
- 2015ORB-SLAM: a Versatile and Accurate Monocular SLAM Systemcited by 988
- 2021LoFTR: Detector-Free Local Feature Matching with Transformerscited by 984
- 2024Grounding Image Matching in 3D with MASt3Rcited by 983
- 2018MVSNet: Depth Inference for Unstructured Multi-view Stereocited by 788
- 2023ScanNet++: A High-Fidelity Dataset of 3D Indoor Scenescited by 764
- 2018MegaDepth: Learning Single-View Depth Prediction from Internet Photoscited by 737
- 2021DROID-SLAM: Deep Visual SLAM for Monocular, Stereo, and RGB-D Camerascited by 687
35 more
- 2021Common Objects in 3D: Large-Scale Learning and Evaluation of Real-life 3D Category Reconstructioncited by 652
- 2018Taskonomy: Disentangling Task Transfer Learningcited by 634
- 2020Hypersim: A Photorealistic Synthetic Dataset for Holistic Indoor Scene Understandingcited by 604
- 2023LightGlue: Local Feature Matching at Light Speedcited by 590
- 2021NICE-SLAM: Neural Implicit Scalable Encoding for SLAMcited by 589
- 2025Continuous 3D Perception Model with Persistent Statecited by 548
- 2020TartanAir: A Dataset to Push the Limits of Visual SLAMcited by 506
- 2019BlendedMVS: A Large-scale Dataset for Generalized Multi-view Stereo Networkscited by 490
- 2021ARKitScenes: A Diverse Real-World Dataset For 3D Indoor Scene Understanding Using Mobile RGB-D Datacited by 454
- 2025Fast3R: Towards 3D Reconstruction of 1000+ Images in One Forward Passcited by 367
- 2025π3: Permutation-Equivariant Visual Geometry Learningcited by 319
- 2021Neural RGB-D Surface Reconstructioncited by 313
- 20243D Reconstruction with Spatial Memorycited by 277
- 2023Visual Geometry Grounded Deep Structure From Motioncited by 227
- 2020PatchmatchNet: Learned Multi-View Patchmatch Stereocited by 207
- 2024MASt3R-SLAM: Real-Time Dense SLAM with 3D Reconstruction Priorscited by 205
- 2023MatrixCity: A Large-scale City Dataset for City-scale Neural Rendering and Beyondcited by 185
- 2025FLARE: Feed-forward Geometry, Appearance and Camera Estimation from Uncalibrated Sparse Viewscited by 180
- 2020Visual Camera Re-Localization from RGB and RGB-D Images Using DSACcited by 176
- 2018BA-Net: Dense Bundle Adjustment Networkcited by 175
- 2025Streaming 4D Visual Geometry Transformercited by 161
- 2017CNN-SLAM: Real-time dense monocular SLAM with learned depth predictioncited by 152
- 2018DynaSLAM: Tracking, Mapping and Inpainting in Dynamic Scenescited by 134
- 2024RGBD Objects in the Wild: Scaling Real-World 3D Object Learning from RGB-D Videoscited by 115
- 2018CubeSLAM: Monocular 3D Object SLAMcited by 102
- 2024SLAM3R: Real-Time Dense Scene Reconstruction from Monocular RGB Videoscited by 102
- 2025Aether: Geometric-Aware Unified World Modelingcited by 97
- 2018DS-SLAM: A Semantic Visual SLAM towards Dynamic Environmentscited by 91
- 2025Point3R: Streaming 3D Reconstruction with Explicit Spatial Pointer Memorycited by 87
- 2023Detector-Free Structure from Motioncited by 71
- 2021LVI-SAM: Tightly-coupled Lidar-Visual-Inertial Odometry via Smoothing and Mappingcited by 45
- 2025LONG3R: Long Sequence Streaming 3D Reconstructioncited by 45
- 2025DeepVerse: 4D Autoregressive Video Generation as a World Modelcited by 40
- 2019Flow-Motion and Depth Network for Monocular Stereo and Beyondcited by 37
- 2025CoMatch: Dynamic Covisibility-Aware Transformer for Bilateral Subpixel-Level Semi-Dense Image Matchingcited by 12
Built on by
Citing papers per year: 2025: 3; 2026: 32.
35 papers.
Sort:
By area:
- 2026InfiniteVGGT: Visual Geometry Grounded Transformer for Endless Streamscited by 56
- 2026SANA-WM: Efficient Minute-Scale World Modeling with Hybrid Linear Diffusion Transformercited by 55
- 2026LingBot-Map: Geometric Context Transformer for Streaming 3D Reconstructioncited by 37
- 2026VGGT-Omegacited by 26
- 2025AMB3R: Accurate Feed-forward Metric-scale 3D Reconstruction with Backendcited by 20
- 2026TTSA3R: Training-Free Temporal-Spatial Adaptive Persistent State for Streaming 3D Reconstructioncited by 11
- 2026MoRe: Motion-aware Feed-forward 4D Reconstruction Transformercited by 9
- 2025LASER: Layer-wise Scale Alignment for Training-Free Streaming 4D Reconstructioncited by 6
- 2025Analyzing the Mechanism of Attention Collapse in VGGT from a Dynamics Perspectivecited by 6
- 2026Mem3R: Streaming 3D Reconstruction with Hybrid Memory via Test-Time Trainingcited by 6
- 2026Feed-Forward 3D Scene Modeling: A Problem-Driven Perspectivecited by 6
- 2026FAST3DIS: Feed-forward Anchored Scene Transformer for 3D Instance Segmentationcited by 4
23 more
- 2026Glob3R: Global Structure-from-Motion with 3D Foundation Modelscited by 4
- 2026FrameVGGT: Coherence-Preserving Memory for Bounded Streaming Geometrycited by 3
- 2026FILT3R: Latent State Adaptive Kalman Filter for Streaming 3D Reconstructioncited by 3
- 2026Attention Itself Could Retrieve.RetrieveVGGT: Training-Free Long Context Streaming 3D Reconstruction via Query-Key Similarity Retrievalcited by 3
- 2026Geo-Align: Video Generation Alignment via Metric Geometry Rewardcited by 3
- 2026R3: 3D Reconstruction via Relative Regressioncited by 2
- 2026Anchor3R: Streaming 3D Reconstruction with Transient Anchors for Long-Horizon Visual Mappingcited by 2
- 2026IGGT4D: Streaming 4D Instance-Grounded Geometry Transformercited by 2
- 20262K Retrofit: Entropy-Guided Efficient Sparse Refinement for High-Resolution 3D Geometry Predictioncited by 1
- 2026Rethinking the State Update Gate for Long-Sequence Recurrent 3D Reconstructioncited by 1
- 2026Revisiting Local Context for Long-Horizon Streaming 3D Reconstructioncited by 1
- 2026Think Locally, Refine Globally for Memory-Efficient 3D Reconstructioncited by 1
- 2026ReCoSplat: Online Feed-Forward Gaussian Splatting via Render-and-Comparecited by 0
- 2026Good Token Hunting: A Hitchhiker's Guide to Token Selection for Visual Geometry Transformerscited by 0
- 2026SpatialBench: Is Your Spatial Foundation Model an All-Round Player?cited by 0
- 2026GeoWeaver: Accurate Long-Sequence 3D Reconstruction via Hierarchical Geometric Assemblycited by 0
- 2026VI3: Grounding Pretrained 3D Foundation Models with Inertial Cuescited by 0
- 2026Scal3R: Learning Efficient Multi-Relative Pose Query for Scalable Online 3D Reconstructioncited by 0
- 2026SURE-Map: Self-Correcting Streaming Geometric Foundation Modelscited by 0
- 2026AMB3R-SLAM: Kilometer-scale SLAM with Hierarchical Backendcited by 0
- 2026RegVGGT: Sustainable Visual Geometry Grounding for Streaming via Regulated Memorycited by 0
- 2026StreamRig: Exploiting Intra-Rig Geometry for Streaming Multi-Camera Odometrycited by 0
- 2026Slot3R: Set-Associative Spatial Memory for Streaming 3D Reconstructioncited by 0
- 2026Slot3R: Set-Associative Spatial Memory for Streaming 3D Reconstruction8 Oct 2026
- 2026StreamRig: Exploiting Intra-Rig Geometry for Streaming Multi-Camera Odometry30 Sep 2026
- 2026RegVGGT: Sustainable Visual Geometry Grounding for Streaming via Regulated Memory20 Sep 2026
- 2026Think Locally, Refine Globally for Memory-Efficient 3D Reconstruction18 Sep 2026
- 2026AMB3R-SLAM: Kilometer-scale SLAM with Hierarchical Backend17 Sep 2026
- 2026SURE-Map: Self-Correcting Streaming Geometric Foundation Models14 Sep 2026
- 2026Scal3R: Learning Efficient Multi-Relative Pose Query for Scalable Online 3D Reconstruction3 Sep 2026
- 2026VI3: Grounding Pretrained 3D Foundation Models with Inertial Cues3 Sep 2026
- 2026Revisiting Local Context for Long-Horizon Streaming 3D Reconstruction27 Aug 2026
- 2026GeoWeaver: Accurate Long-Sequence 3D Reconstruction via Hierarchical Geometric Assembly18 Aug 2026
- 2026IGGT4D: Streaming 4D Instance-Grounded Geometry Transformer21 Jul 2026
- 2026Glob3R: Global Structure-from-Motion with 3D Foundation Models10 Jul 2026
23 more
- 2026Anchor3R: Streaming 3D Reconstruction with Transient Anchors for Long-Horizon Visual Mapping3 Jun 2026
- 2026SpatialBench: Is Your Spatial Foundation Model an All-Round Player?26 May 2026
- 2026R3: 3D Reconstruction via Relative Regression26 May 2026
- 2026Geo-Align: Video Generation Alignment via Metric Geometry Reward22 May 2026
- 2026Good Token Hunting: A Hitchhiker's Guide to Token Selection for Visual Geometry Transformers22 May 2026
- 2026Rethinking the State Update Gate for Long-Sequence Recurrent 3D Reconstruction16 May 2026
- 2026VGGT-Omega14 May 2026
- 2026SANA-WM: Efficient Minute-Scale World Modeling with Hybrid Linear Diffusion Transformer14 May 2026
- 2026Attention Itself Could Retrieve.RetrieveVGGT: Training-Free Long Context Streaming 3D Reconstruction via Query-Key Similarity Retrieval10 May 2026
- 2026LingBot-Map: Geometric Context Transformer for Streaming 3D Reconstruction15 Apr 2026
- 2026Feed-Forward 3D Scene Modeling: A Problem-Driven Perspective15 Apr 2026
- 2026Mem3R: Streaming 3D Reconstruction with Hybrid Memory via Test-Time Training8 Apr 2026
- 2026FAST3DIS: Feed-forward Anchored Scene Transformer for 3D Instance Segmentation27 Mar 2026
- 20262K Retrofit: Entropy-Guided Efficient Sparse Refinement for High-Resolution 3D Geometry Prediction20 Mar 2026
- 2026FILT3R: Latent State Adaptive Kalman Filter for Streaming 3D Reconstruction19 Mar 2026
- 2026ReCoSplat: Online Feed-Forward Gaussian Splatting via Render-and-Compare10 Mar 2026
- 2026FrameVGGT: Coherence-Preserving Memory for Bounded Streaming Geometry8 Mar 2026
- 2026MoRe: Motion-aware Feed-forward 4D Reconstruction Transformer5 Mar 2026
- 2026TTSA3R: Training-Free Temporal-Spatial Adaptive Persistent State for Streaming 3D Reconstruction30 Jan 2026
- 2026InfiniteVGGT: Visual Geometry Grounded Transformer for Endless Streams5 Jan 2026
- 2025Analyzing the Mechanism of Attention Collapse in VGGT from a Dynamics Perspective25 Dec 2025
- 2025LASER: Layer-wise Scale Alignment for Training-Free Streaming 4D Reconstruction15 Dec 2025
- 2025AMB3R: Accurate Feed-forward Metric-scale 3D Reconstruction with Backend25 Nov 2025
- 2026InfiniteVGGT: Visual Geometry Grounded Transformer for Endless Streamscited by 56
- 2026LingBot-Map: Geometric Context Transformer for Streaming 3D Reconstructioncited by 37
- 2026VGGT-Omegacited by 26
- 2025AMB3R: Accurate Feed-forward Metric-scale 3D Reconstruction with Backendcited by 20
- 2026TTSA3R: Training-Free Temporal-Spatial Adaptive Persistent State for Streaming 3D Reconstructioncited by 11
- 2026MoRe: Motion-aware Feed-forward 4D Reconstruction Transformercited by 9
- 2025LASER: Layer-wise Scale Alignment for Training-Free Streaming 4D Reconstructioncited by 6
- 2025Analyzing the Mechanism of Attention Collapse in VGGT from a Dynamics Perspectivecited by 6
- 2026Mem3R: Streaming 3D Reconstruction with Hybrid Memory via Test-Time Trainingcited by 6
- 2026Feed-Forward 3D Scene Modeling: A Problem-Driven Perspectivecited by 6
- 2026FAST3DIS: Feed-forward Anchored Scene Transformer for 3D Instance Segmentationcited by 4
- 2026FILT3R: Latent State Adaptive Kalman Filter for Streaming 3D Reconstructioncited by 3
12 most cited of 31 All 31 (JSON)
- 2026Slot3R: Set-Associative Spatial Memory for Streaming 3D Reconstruction8 Oct 2026
- 2026StreamRig: Exploiting Intra-Rig Geometry for Streaming Multi-Camera Odometry30 Sep 2026
- 2026RegVGGT: Sustainable Visual Geometry Grounding for Streaming via Regulated Memory20 Sep 2026
- 2026Think Locally, Refine Globally for Memory-Efficient 3D Reconstruction18 Sep 2026
- 2026AMB3R-SLAM: Kilometer-scale SLAM with Hierarchical Backend17 Sep 2026
- 2026SURE-Map: Self-Correcting Streaming Geometric Foundation Models14 Sep 2026
- 2026Scal3R: Learning Efficient Multi-Relative Pose Query for Scalable Online 3D Reconstruction3 Sep 2026
- 2026VI3: Grounding Pretrained 3D Foundation Models with Inertial Cues3 Sep 2026
- 2026Revisiting Local Context for Long-Horizon Streaming 3D Reconstruction27 Aug 2026
- 2026GeoWeaver: Accurate Long-Sequence 3D Reconstruction via Hierarchical Geometric Assembly18 Aug 2026
- 2026IGGT4D: Streaming 4D Instance-Grounded Geometry Transformer21 Jul 2026
- 2026Anchor3R: Streaming 3D Reconstruction with Transient Anchors for Long-Horizon Visual Mapping3 Jun 2026
12 newest of 31 All 31 (JSON)