OVGGT: O(1) Constant-Cost Streaming Visual Geometry Transformer
On the map: Efficient LLM inference and serving → Token pruning and merging for ViTs
Abstract (arXiv)
Reconstructing 3D geometry from streaming video requires continuous inference under bounded resources. Recent geometric foundation models achieve impressive reconstruction quality through all-to-all attention, yet their quadratic cost confines them to short, offline sequences. Causal-attention variants such as StreamVGGT enable single-pass streaming but accumulate an ever-growing KV cache, exhausting GPU memory within hundreds of frames and precluding the long-horizon deployment that motivates streaming inference in the first place. We present OVGGT, a training-free framework that bounds both memory and compute to a fixed budget regardless of sequence length. Our approach combines Self-Selective Caching, which leverages FFN residual magnitudes to compress the KV cache while remaining fully compatible with FlashAttention, with Dynamic Anchor Protection, which shields coordinate-critical tokens from eviction to suppress geometric drift over extended trajectories. Extensive experiments on indoor, outdoor, and ultra-long sequence benchmarks demonstrate that OVGGT processes arbitrarily long videos within a constant VRAM envelope while achieving state-of-the-art 3D geometric accuracy. Project page: https://vaisr.github.io/OVGGT/ Code: https://github.com/VAISR/OVGGT
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Token pruning and merging for ViTs, one of 12 directions in Efficient LLM inference and serving. Builds on 34 of its 44 references that are in the map. First posted on arXiv 6 Mar 2026.
Builds on
34 of 44 references.
Closest ancestors · 1
Same direction, newest first
- 2025Evict3R: Training-Free Token Eviction for Memory-Bounded Streaming Visual Geometry Transformers22 Sep
Other references · 33
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
- 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,088
- 2023FlashAttention-2: Faster Attention with Better Parallelism and Work Partitioningcited by 2,551
- 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,526
- 2025VGGT: Visual Geometry Grounded Transformercited by 1,475
- 2019SuperGlue: Learning Feature Matching with Graph Neural Networkscited by 1,437
- 2017SuperPoint: Self-Supervised Interest Point Detection and Descriptioncited by 1,313
- 2015ORB-SLAM: a Versatile and Accurate Monocular SLAM Systemcited by 983
- 2024Grounding Image Matching in 3D with MASt3Rcited by 960
- 2020ORB-SLAM3: An Accurate Open-Source Library for Visual, Visual-Inertial and Multi-Map SLAMcited by 862
- 2016ORB-SLAM2: an Open-Source SLAM System for Monocular, Stereo and RGB-D Camerascited by 801
- 2018MVSNet: Depth Inference for Unstructured Multi-view Stereocited by 780
21 more
- 2021Going deeper with Image Transformerscited by 759
- 2021DROID-SLAM: Deep Visual SLAM for Monocular, Stereo, and RGB-D Camerascited by 673
- 2023LightGlue: Local Feature Matching at Light Speedcited by 583
- 2025Continuous 3D Perception Model with Persistent Statecited by 527
- 2024MonST3R: A Simple Approach for Estimating Geometry in the Presence of Motioncited by 431
- 2019Cascade Cost Volume for High-Resolution Multi-View Stereo and Stereo Matchingcited by 414
- 2025Fast3R: Towards 3D Reconstruction of 1000+ Images in One Forward Passcited by 356
- 2021Neural RGB-D Surface Reconstructioncited by 312
- 2024Ada-KV: Optimizing KV Cache Eviction by Adaptive Budget Allocation for Efficient LLM Inferencecited by 230
- 2023Visual Geometry Grounded Deep Structure From Motioncited by 225
- 2024Global Structure-from-Motion Revisitedcited by 215
- 2020PatchmatchNet: Learned Multi-View Patchmatch Stereocited by 204
- 2024MASt3R-SLAM: Real-Time Dense SLAM with 3D Reconstruction Priorscited by 198
- 2022Deep Patch Visual Odometrycited by 186
- 2019ReFusion: 3D Reconstruction in Dynamic Environments for RGB-D Cameras Exploiting Residualscited by 180
- 2025MUSt3R: Multi-view Network for Stereo 3D Reconstructioncited by 139
- 2024MV-DUSt3R+: Single-Stage Scene Reconstruction from Sparse Views In 2 Secondscited by 136
- 2025TTT3R: 3D Reconstruction as Test-Time Trainingcited by 122
- 2024Deep Patch Visual SLAMcited by 68
- 2026InfiniteVGGT: Visual Geometry Grounded Transformer for Endless Streamscited by 51
- 2025Representation Shift: Unifying Token Compression with FlashAttentioncited by 5
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026FrameVGGT: Coherence-Preserving Memory for Bounded Streaming Geometry
- 2026XStreamVGGT: Extremely Memory-Efficient Streaming Vision Geometry Grounded Transformer with KV Cache Compression
- 2026XStreamVGGT: Extremely Memory-Efficient Streaming Vision Geometry Grounded Transformer with KV Cache Compression
- 2025LiteVGGT: Boosting Vanilla VGGT via Geometry-aware Cached Token Merging
- 2025FastVGGT: Training-Free Acceleration of Visual Geometry Transformer
- 2026GHOST: Geometry-Hierarchical Online Streaming Token Eviction for Efficient 3D Reconstruction
- 2026Attention Itself Could Retrieve.RetrieveVGGT: Training-Free Long Context Streaming 3D Reconstruction via Query-Key Similarity Retrieval
- 2026LongStream: Long-Sequence Streaming Autoregressive Visual Geometry