When Should the Count Change? Learning State Maintenance for Causal Video Counting
Not on the map. Why?
Abstract (arXiv)
Continuous video counting requires distinguishing new observations from new objects or completed events. We introduce StaMina (State Maintenance), which learns to maintain counting state through state-conditioned updates. Recurrent visual context supports recognition; learned transitions maintain visibility, persistent identities, and completed-event records. A differentiable recurrence trains event transitions over legal paths constrained by count endpoints; visibility and association objectives train the object branch. A multi-source pipeline organizes 39.8K spatial queries and complementary event annotations into counting trajectories. On SVCBench, we evaluate counting adaptation with partial video overlap and held-out groups of linked annotations. Under prefix replay (Full) and persistent streaming (Stream), 4B and 8B models reach 41.9/36.4 and 44.9/38.2 Gaussian Precision Accuracy, respectively. The 8B model gains 10.9/3.2 points over Counting-SFT on the same queries. Matched-graph comparisons isolate phase conditioning and trajectory supervision, assessing training objectives alongside hard decisions. Online video benchmarks and count-conditioned decisions assess online understanding and task eligibility. Project Page: https://PLACEHOLDER.github.io/StaMina/
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 45 of its 52 references that are in the map. First posted on arXiv 28 Sep 2026.
Builds on
45 of 52 references.
References · 45
- 2016Layer Normalizationcited by 5,669
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2016Gaussian Error Linear Units (GELUs)cited by 3,502
- 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,117
- 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,887
- 2025Qwen3-VL Technical Reportcited by 2,793
- 2021Ego4D: Around the World in 3,000 Hours of Egocentric Videocited by 1,556
- 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiencycited by 1,510
- 2024Video-MME: The First-Ever Comprehensive Evaluation Benchmark of Multi-modal LLMs in Video Analysiscited by 1,413
- 2023ScanNet++: A High-Fidelity Dataset of 3D Indoor Scenescited by 764
- 2024LongVideoBench: A Benchmark for Long-context Interleaved Video-Language Understandingcited by 665
- 2024Thinking in Space: How Multimodal Large Language Models See, Remember, and Recall Spacescited by 611
33 more
- 2024Gated Delta Networks: Improving Mamba2 with Delta Rulecited by 532
- 2026Kimi K2.5: Visual Agentic Intelligencecited by 501
- 2021ARKitScenes: A Diverse Real-World Dataset For 3D Indoor Scene Understanding Using Mobile RGB-D Datacited by 454
- 2024Learning to (Learn at Test Time): RNNs with Expressive Hidden Statescited by 355
- 2022Test-Time Training with Masked Autoencoderscited by 212
- 2025Kimi Linear: An Expressive, Efficient Attention Architecturecited by 196
- 2024Flash-VStream: Memory-Based Real-Time Understanding for Long Video Streamscited by 169
- 2024Streaming Long Video Understanding with Large Language Modelscited by 167
- 2024StreamingBench: Assessing the Gap for MLLMs to Achieve Streaming Video Understandingcited by 144
- 2025OVO-Bench: How Far is Your Video-LLMs from Real-World Online Video Understanding?cited by 142
- 2026Molmo2: Open Weights and Data for Vision-Language Models with Video Understanding and Groundingcited by 139
- 2025Cambrian-S: Towards Spatial Supersensing in Videocited by 134
- 2025Dispider: Enabling Video LLMs with Active Real-Time Interaction via Disentangled Perception, Decision, and Reactioncited by 127
- 2025One-Minute Video Generation with Test-Time Trainingcited by 101
- 2025StreamingVLM: Real-Time Understanding for Infinite Video Streamscited by 95
- 2025StreamForest: Efficient Online Video Understanding with Persistent Event Memorycited by 78
- 2024TOMATO: Assessing Visual Temporal Reasoning Capabilities in Multimodal Foundation Modelscited by 73
- 2018NeuralNetwork-Viterbi: A Framework for Weakly Supervised Video Learningcited by 67
- 2025End-to-End Test-Time Training for Long Contextcited by 62
- 2023Test-Time Training on Video Streamscited by 37
- 2025LiveStar: Live Streaming Assistant for Real-World Online Video Understandingcited by 25
- 2025AV-Reasoner: Improving and Benchmarking Clue-Grounded Audio-Visual Counting for MLLMscited by 16
- 2025CountLLM: Towards Generalizable Repetitive Action Counting via Large Language Modelcited by 14
- 2026Spatial-TTT: Streaming Visual-based Spatial Intelligence with Test-Time Trainingcited by 11
- 2025Test-Time Visual In-Context Tuningcited by 7
- 2026SVCBench: A Streaming Video Counting Benchmark for Spatial-Temporal State Maintenancecited by 6
- 2026OVO-S-Bench: A Hierarchical Benchmark for Streaming Spatial Intelligence in Multimodal LLMscited by 6
- 2026StreamTTT: Reconciling Real-Time Perception and Long-Term Memory in Streaming VLMscited by 5
- 2024ActionSwitch: Class-agnostic Detection of Simultaneous Actions in Streaming Videoscited by 4
- 2026Video-MME-Logical: A Controlled Diagnostic Benchmark for Video Temporal-Logical Reasoningcited by 4
- 2026ClipTTT: CLIP-Guided Test-Time Training Helps LVLMs See Bettercited by 2
- 2026MedClaw: Heuristic Agent Harness for Long-Horizon Surgical Video Reasoningcited by 2
- 2026TRACE: Temporal Retrieval with Anchored and Convergent Evidence for Long-Horizon Video Understandingcited by 2
Built on by
Not cited yet.