CREST: Curvature-Regulated Event-Centric Sampling for Efficient Long-Video Understanding
Not on the map. Why?
Abstract (arXiv)
Selecting informative frames from long videos is a combinatorial problem that existing methods address either through efficient heuristics without explicit modeling of query-conditioned temporal structure, or through multi stage retrieval pipelines with substantial preprocessing cost. We propose CREST, a training-free frame selection method grounded in the temporal geometry of query--frame relevance. CREST is based on the observation that relevance over time exhibits structured local variation: sharp curvature around salient events and flatter regions in redundant segments. By using local curvature to guide selection, CREST allocates a fixed frame budget more effectively across brief decisive events and slowly evolving evidence. Under a fixed backbone and frame budget, CREST achieves higher accuracy than AKS, a lightweight relevance--coverage baseline, on LongVideoBench and VideoMME, while retaining 93--95% of the accuracy of MIRA, a stronger multi-stage retrieval pipeline, at only 3--4% of its preprocessing cost.footnoteCode and implementation details are included in the supplementary material and will be released publicly upon acceptance. On TempRel, our diagnostic benchmark for temporal frame selection, CREST achieves a 6.88% relative improvement over AKS. Pairwise LLM-as-a-judge evaluation further shows that CREST-selected frames yield more coherent frame-conditioned descriptions, with win rates of 60.58% and 54.50% on the two benchmarks. These results show that local temporal geometry provides a simple and efficient basis for long-video frame selection.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 21 of its 46 references that are in the map. First posted on arXiv 9 May 2026.
Builds on
21 of 46 references.
References · 21
- 2024Gemini 1.5: Unlocking multimodal understanding across millions of tokens of contextcited by 3,224
- 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Taskscited by 2,565
- 2023Qwen-VL: A Versatile Vision-Language Model for Understanding, Localization, Text Reading, and Beyondcited by 2,224
- 2024Video-MME: The First-Ever Comprehensive Evaluation Benchmark of Multi-modal LLMs in Video Analysiscited by 1,413
- 2023Video-LLaVA: Learning United Visual Representation by Alignment Before Projectioncited by 1,402
- 2024MiniCPM-V: A GPT-4V Level MLLM on Your Phonecited by 1,079
- 2023VILA: On Pre-training for Visual Language Modelscited by 692
- 2024LongVideoBench: A Benchmark for Long-context Interleaved Video-Language Understandingcited by 665
- 2024LLaVA-Video: Video Instruction Tuning With Synthetic Datacited by 583
- 2024LongVU: Spatiotemporal Adaptive Compression for Long Video-Language Understandingcited by 356
- 2024VideoAgent: Long-form Video Understanding with Large Language Model as Agentcited by 332
- 2024PLLaVA : Parameter-free LLaVA Extension from Images to Videos for Video Dense Captioningcited by 322
9 more
- 2024LongVILA: Scaling Long-Context Visual Language Models for Long Videoscited by 309
- 2024VideoTree: Adaptive Tree-based Video Representation for LLM Reasoning on Long Videoscited by 251
- 2025M-LLM Based Video Frame Selection for Efficient Video Understandingcited by 88
- 2025T*: Re-thinking Temporal Search for Long-Form Video Understandingcited by 82
- 2025BOLT: Boost Large Vision-Language Model Without Training for Long-form Video Understandingcited by 75
- 2025AdaReTaKe: Adaptive Redundancy Reduction to Perceive Longer for Video-language Understandingcited by 48
- 2025Scaling Video-Language Models to 10K Frames via Hierarchical Differential Distillationcited by 37
- 2025TSPO: Temporal Sampling Policy Optimization for Long-form Video Language Understandingcited by 25
- 2025APVR: Hour-Level Long Video Understanding with Adaptive Pivot Visual Information Retrievalcited by 7
Built on by
Citing papers per year: 2026: 1.
1 paper.