Grounding with Confidence: Controllable Generative Video Temporal Grounding
Not on the map. Why?
Abstract (arXiv)
Video temporal grounding supports applications such as video search, content review, and automated editing by localizing events described in natural language. Yet existing generative models typically output timestamps without explicit interval-level confidence scores to guide candidate selection. We separate candidate generation from acceptance by scoring individual intervals within the original decoding pass. A lightweight confidence head reads pooled decoder states, providing an explicit score trained for interval selection. Offline verifier scores supervise the head on fixed candidate sequences, and temporal-overlap labels adapt it to current rollouts during reinforcement learning. GT-anchored candidate-pool supervision and set-level optimization train the generator. The resulting scores support ranking, threshold-based selection, and rejection without invoking an external verifier at inference. On a fixed OMTG-Bench candidate pool, confidence raises query-macro [email protected] from 9.95% to 14.42% over generation order at a 10% global return budget, and from 26.48% to 31.12% at a 25% budget. The continuous scores let downstream applications adjust return budgets or acceptance thresholds to match their precision-recall preferences, without regenerating candidate intervals.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 27 of its 32 references that are in the map. First posted on arXiv 30 Sep 2026.
Builds on
27 of 32 references.
References · 27
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
- 2017On Calibration of Modern Neural Networkscited by 4,860
- 2023Semantic Uncertainty: Linguistic Invariances for Uncertainty Estimation in Natural Language Generationcited by 795
- 2023Just Ask for Calibration: Strategies for Eliciting Calibrated Confidence Scores from Language Models Fine-Tuned with Human Feedbackcited by 788
- 2023The Internal State of an LLM Knows When It's Lyingcited by 644
- 2017TALL: Temporal Activity Localization via Language Querycited by 581
- 2023TimeChat: A Time-sensitive Multimodal Large Language Model for Long Video Understandingcited by 399
- 2019SelectiveNet: A Deep Neural Network with an Integrated Reject Optioncited by 333
- 2023VTimeLLM: Empower LLM to Grasp Video Momentscited by 253
- 2024Semantic Entropy Probes: Robust and Cheap Hallucination Detection in LLMscited by 246
- 2023UniVTG: Towards Unified Video-Language Temporal Groundingcited by 189
- 2019Addressing Failure Prediction by Learning Model Confidencecited by 183
15 more
- 2023Query-Dependent Video Representation for Moment Retrieval and Highlight Detectioncited by 166
- 2025Time-R1: Post-Training Large Vision Language Model for Temporal Video Groundingcited by 138
- 2024Grounded-VideoLLM: Sharpening Fine-grained Temporal Grounding in Video Large Language Modelscited by 87
- 2024Number it: Temporal Grounding Videos like Flipping Mangacited by 65
- 2025TimeLens: Rethinking Video Temporal Grounding with Multimodal LLMscited by 46
- 2024On the Consistency of Video Large Language Models in Temporal Comprehensioncited by 18
- 2025TimeExpert: An Expert-Guided Video LLM for Video Temporal Groundingcited by 14
- 2025Enrich and Detect: Video Temporal Grounding with Multimodal LLMscited by 12
- 2025Moment of Untruth: Dealing with Negative Queries in Video Moment Retrievalcited by 9
- 2026Not All Inputs Are Valid: Towards Open-Set Video Moment Retrieval Using Languagecited by 6
- 2025Learning to Refuse: Refusal-Aware Reinforcement Fine-Tuning for Hard-Irrelevant Queries in Video Temporal Groundingcited by 2
- 2026Towards One-to-Many Temporal Groundingcited by 2
- 2025Uncertainty-quantified Rollout Policy Adaptation for Unlabelled Cross-domain Temporal Groundingcited by 1
- 2026TimeLens2: Generalist Video Temporal Grounding with Multimodal LLMscited by 1
- 2026CAVE: Competence-Aware Visual Boundary Evidence Alignment for Video Temporal Groundingcited by 1
Built on by
Not cited yet.