Conformal Coverage Guarantees for Any Video Temporal Grounder
Not on the map. Why?
Abstract (arXiv)
Event boundaries in continuous video are ambiguous: re-annotate the same query-video pair and independent annotators mark moments that overlap by less than half on a large fraction of samples. The ground truth for video temporal grounding is therefore a distribution over intervals, yet every grounder returns a single interval with no statement of reliability, so at deployment a wrong interval is indistinguishable from a right one. COVER changes the output object: a post-hoc, model-agnostic wrapper that turns any grounder, a trained localizer or a black-box video--language model, into one that emits a temporal region containing the true moment with probability at least 1-α, by calibrating the quantile of a temporal nonconformity score on held-out labels and widening the base prediction by that amount. The guarantee is finite-sample and distribution-free under exchangeability, and requires neither retraining nor white-box access. We give two score families, a two-sided boundary-widening score for grounders that emit an interval and a super-level-set score for grounders that emit a relevance signal, and develop theory specific to grounding that bounds how large the certified region becomes, when coverage survives conditioning on event length, and how it degrades when moments from one video break exchangeability. Across three benchmarks and five grounders, realized coverage tracks the target, and calibration exposes what point metrics hide.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 34 of its 45 references that are in the map. First posted on arXiv 7 Aug 2026.
Builds on
34 of 45 references.
References · 34
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2017Dense-Captioning Events in Videoscited by 793
- 2021A Gentle Introduction to Conformal Prediction and Distribution-Free Uncertainty Quantificationcited by 792
- 2016Distribution-Free Predictive Inference For Regressioncited by 668
- 2019Conformalized Quantile Regressioncited by 629
- 2017TALL: Temporal Activity Localization via Language Querycited by 584
- 2019Conformal Prediction Under Covariate Shiftcited by 519
- 2021Adaptive Conformal Inference Under Distribution Shiftcited by 375
- 2020Uncertainty Sets for Image Classifiers using Conformal Predictioncited by 366
- 2022Conformal prediction beyond exchangeabilitycited by 355
- 2022Conformal Risk Controlcited by 299
- 2021Distribution-Free, Risk-Controlling Prediction Setscited by 288
22 more
- 2021Learn then Test: Calibrating Predictive Algorithms to Achieve Risk Controlcited by 271
- 2023VTimeLLM: Empower LLM to Grasp Video Momentscited by 255
- 2023UniVTG: Towards Unified Video-Language Temporal Groundingcited by 190
- 2023Query-Dependent Video Representation for Moment Retrieval and Highlight Detectioncited by 166
- 2023Conformal Prediction With Conditional Guaranteescited by 152
- 2024Theoretical Foundations of Conformal Predictioncited by 101
- 2024TR-DETR: Task-Reciprocal Transformer for Joint Moment Retrieval and Highlight Detectioncited by 59
- 2020Uncovering Hidden Challenges in Query-Based Video Moment Retrievalcited by 58
- 2022Temporal Sentence Grounding in Videos: A Survey and Future Directionscited by 37
- 2023Non-Exchangeable Conformal Risk Controlcited by 29
- 2023BAM-DETR: Boundary-Aligned Moment Detection Transformer for Temporal Sentence Grounding in Videoscited by 29
- 2022Video Activity Localisation with Uncertainties in Temporal Boundarycited by 24
- 2024Adaptive Bounding Box Uncertainties via Two-Step Conformal Predictioncited by 23
- 2023Confident Object Detection via Conformal Prediction and Conformal Risk Control: an Application to Railway Signalingcited by 22
- 2024Beyond Uncertainty: Evidential Deep Learning for Robust Video Temporal Groundingcited by 10
- 2024Lighthouse: A User-Friendly Library for Reproducible Video Moment Retrieval and Highlight Detectioncited by 5
- 2025Adaptive Evidential Learning for Temporal-Semantic Robustness in Moment Retrievalcited by 4
- 2025Conformal Object Detection by Sequential Risk Controlcited by 3
- 2025Explicit Abstention Knobs for Predictable Reliability in Video Question Answeringcited by 3
- 2023Towards Diverse Temporal Grounding under Single Positive Labelscited by 1
- 2026Conformal Prediction Sets for Instance Segmentationcited by 1
- 2026Foresee-to-Ground: From Predictive Temporal Perception to Evidence-Driven Reasoning for Video Temporal Groundingcited by 1
Built on by
Not cited yet.