mlsanityData to 7 Oct 2026

OVGGT: O(1) Constant-Cost Streaming Visual Geometry Transformer

arXiv 2603.05959 ↗First posted 6 Mar 2026cs.CVcited by 1

On the map: Efficient LLM inference and serving → Token pruning and merging for ViTs

Abstract (arXiv)

Reconstructing 3D geometry from streaming video requires continuous inference under bounded resources. Recent geometric foundation models achieve impressive reconstruction quality through all-to-all attention, yet their quadratic cost confines them to short, offline sequences. Causal-attention variants such as StreamVGGT enable single-pass streaming but accumulate an ever-growing KV cache, exhausting GPU memory within hundreds of frames and precluding the long-horizon deployment that motivates streaming inference in the first place. We present OVGGT, a training-free framework that bounds both memory and compute to a fixed budget regardless of sequence length. Our approach combines Self-Selective Caching, which leverages FFN residual magnitudes to compress the KV cache while remaining fully compatible with FlashAttention, with Dynamic Anchor Protection, which shields coordinate-critical tokens from eviction to suppress geometric drift over extended trajectories. Extensive experiments on indoor, outdoor, and ultra-long sequence benchmarks demonstrate that OVGGT processes arbitrarily long videos within a constant VRAM envelope while achieving state-of-the-art 3D geometric accuracy. Project page: https://vaisr.github.io/OVGGT/ Code: https://github.com/VAISR/OVGGT

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Token pruning and merging for ViTs, one of 12 directions in Efficient LLM inference and serving. Builds on 34 of its 44 references that are in the map. First posted on arXiv 6 Mar 2026.

Builds on

34 of 44 references.

Closest ancestors · 1

Same direction, newest first

  1. 2025Evict3R: Training-Free Token Eviction for Memory-Bounded Streaming Visual Geometry Transformers22 Sep

Other references · 33

  1. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
  2. 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,088
  3. 2023FlashAttention-2: Faster Attention with Better Parallelism and Work Partitioningcited by 2,551
  4. 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,526
  5. 2025VGGT: Visual Geometry Grounded Transformercited by 1,475
  6. 2019SuperGlue: Learning Feature Matching with Graph Neural Networkscited by 1,437
  7. 2017SuperPoint: Self-Supervised Interest Point Detection and Descriptioncited by 1,313
  8. 2015ORB-SLAM: a Versatile and Accurate Monocular SLAM Systemcited by 983
  9. 2024Grounding Image Matching in 3D with MASt3Rcited by 960
  10. 2020ORB-SLAM3: An Accurate Open-Source Library for Visual, Visual-Inertial and Multi-Map SLAMcited by 862
  11. 2016ORB-SLAM2: an Open-Source SLAM System for Monocular, Stereo and RGB-D Camerascited by 801
  12. 2018MVSNet: Depth Inference for Unstructured Multi-view Stereocited by 780
21 more
  1. 2021Going deeper with Image Transformerscited by 759
  2. 2021DROID-SLAM: Deep Visual SLAM for Monocular, Stereo, and RGB-D Camerascited by 673
  3. 2023LightGlue: Local Feature Matching at Light Speedcited by 583
  4. 2025Continuous 3D Perception Model with Persistent Statecited by 527
  5. 2024MonST3R: A Simple Approach for Estimating Geometry in the Presence of Motioncited by 431
  6. 2019Cascade Cost Volume for High-Resolution Multi-View Stereo and Stereo Matchingcited by 414
  7. 2025Fast3R: Towards 3D Reconstruction of 1000+ Images in One Forward Passcited by 356
  8. 2021Neural RGB-D Surface Reconstructioncited by 312
  9. 2024Ada-KV: Optimizing KV Cache Eviction by Adaptive Budget Allocation for Efficient LLM Inferencecited by 230
  10. 2023Visual Geometry Grounded Deep Structure From Motioncited by 225
  11. 2024Global Structure-from-Motion Revisitedcited by 215
  12. 2020PatchmatchNet: Learned Multi-View Patchmatch Stereocited by 204
  13. 2024MASt3R-SLAM: Real-Time Dense SLAM with 3D Reconstruction Priorscited by 198
  14. 2022Deep Patch Visual Odometrycited by 186
  15. 2019ReFusion: 3D Reconstruction in Dynamic Environments for RGB-D Cameras Exploiting Residualscited by 180
  16. 2025MUSt3R: Multi-view Network for Stereo 3D Reconstructioncited by 139
  17. 2024MV-DUSt3R+: Single-Stage Scene Reconstruction from Sparse Views In 2 Secondscited by 136
  18. 2025TTT3R: 3D Reconstruction as Test-Time Trainingcited by 122
  19. 2024Deep Patch Visual SLAMcited by 68
  20. 2026InfiniteVGGT: Visual Geometry Grounded Transformer for Endless Streamscited by 51
  21. 2025Representation Shift: Unifying Token Compression with FlashAttentioncited by 5

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026FrameVGGT: Coherence-Preserving Memory for Bounded Streaming Geometry
  2. 2026XStreamVGGT: Extremely Memory-Efficient Streaming Vision Geometry Grounded Transformer with KV Cache Compression
  3. 2026XStreamVGGT: Extremely Memory-Efficient Streaming Vision Geometry Grounded Transformer with KV Cache Compression
  4. 2025LiteVGGT: Boosting Vanilla VGGT via Geometry-aware Cached Token Merging
  5. 2025FastVGGT: Training-Free Acceleration of Visual Geometry Transformer
  6. 2026GHOST: Geometry-Hierarchical Online Streaming Token Eviction for Efficient 3D Reconstruction
  7. 2026Attention Itself Could Retrieve.RetrieveVGGT: Training-Free Long Context Streaming 3D Reconstruction via Query-Key Similarity Retrieval
  8. 2026LongStream: Long-Sequence Streaming Autoregressive Visual Geometry