TRACE: Evidence Grounding-Guided Multi-Video Event Understanding and Claim Generation
Not on the map. Why?
Abstract (arXiv)
Multi-video event understanding demands models that can locate and attribute query-relevant evidence scattered across long, heterogeneous video corpora. Existing large vision-language models (LVLMs) often underperform in this regime because they quickly exhaust their context budget and struggle to precisely localize evidentially important segments, frequently missing dense informational cues such as broadcast graphics, subtitles, and scoreboards. We introduce TRACE, an evidence grounding-guided framework that follows a ground-before-reasoning strategy for multi-video event reasoning. Our approach first builds a structured, text-searchable timeline for each video using OCR and object detection. A text-only LLM then conducts query-aware evidence localization, selecting relevant moments prior to any downstream visual reasoning. The retrieved frames and their grounding summaries are subsequently used to steer LVLM-based claim generation and cross-video citation consolidation. Experiments on MAGMaR 2026 and WikiVideo demonstrate that structured grounding markedly boosts factual completeness and attribution fidelity. On the MAGMaR validation split, TRACE raises macro-average MiRAGE F1 from 0.705 to 0.811 compared to an unguided Qwen3-VL-30B baseline, with especially strong improvements in citation recall from 0.440 to 0.628. The method also attains state-of-the-art results on the official MAGMaR 2026 leaderboard. Code is released at https://github.com/pengyu965/TRACE.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 20 of its 33 references that are in the map. First posted on arXiv 16 May 2026.
Builds on
20 of 33 references.
References · 20
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
- 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,274
- 2023Self-RAG: Learning to Retrieve, Generate, and Critique through Self-Reflectioncited by 1,800
- 2023Video-LLaVA: Learning United Visual Representation by Alignment Before Projectioncited by 1,385
- 2024Video-MME: The First-Ever Comprehensive Evaluation Benchmark of Multi-modal LLMs in Video Analysiscited by 1,375
- 2021Improving language models by retrieving from trillions of tokenscited by 1,278
- 2023HuggingGPT: Solving AI Tasks with ChatGPT and its Friends in Hugging Facecited by 1,173
- 2024LongVideoBench: A Benchmark for Long-context Interleaved Video-Language Understandingcited by 644
- 2023ViperGPT: Visual Inference via Python Execution for Reasoningcited by 591
- 2023MM-REACT: Prompting ChatGPT for Multimodal Reasoning and Actioncited by 511
- 2022Visual Programming: Compositional visual reasoning without trainingcited by 507
- 2019Scene Text Visual Question Answeringcited by 327
8 more
- 2025YOLOv12: Attention-Centric Real-Time Object Detectorscited by 300
- 2020PP-OCR: A Practical Ultra Lightweight OCR Systemcited by 147
- 2021QVHighlights: Detecting Moments and Highlights in Videos via Natural Language Queriescited by 72
- 2024Artemis: Towards Referential Understanding in Complex Videoscited by 25
- 2024MultiVENT 2.0: A Massive Multilingual Benchmark for Event-Centric Video Retrievalcited by 17
- 2024ChartReformer: Natural Language-Driven Chart Image Editingcited by 13
- 2025WikiVideo: Article Generation from Multiple Videoscited by 13
- 2026Unified Multimodal Uncertain Inferencecited by 3
Built on by
Citing papers per year: 2026: 3.
3 papers.
- 2026MultiVENT-Raw: A Benchmark for Retrieval and Reasoning over Raw Videos23 Sep 2026
- 2026OSEF: One-Step Evidence Fusion for Cross-Video Scene Procedure Planning31 Jul 2026
- 2026Findings of the MAGMaR 2026 Shared Task10 Jun 2026
Similar, not cited
Close in wording, no citation either way
- 2026Keeping the Evidence Chain: Semantic Evidence Allocation for Training-Free Token Pruning in Video Temporal Grounding
- 2026Beyond Frame Selection: Rethinking Long-Video Understanding with MLLMs
- 2026Semantic and Visual Evidence for Efficient Long-Video Reasoning: A Solution for the HD-EPIC VQA Challenge
- 2026Foresee-to-Ground: From Predictive Temporal Perception to Evidence-Driven Reasoning for Video Temporal Grounding
- 2026Video Evidence to Reasoning Efficient Video Understanding via Explicit Evidence Grounding
- 2026SER: Learning to Ground Video Reasoning with Semantic Evidence Rewards
- 2026Entropy-Gradient Grounding: Training-Free Evidence Retrieval in Vision-Language Models
- 2026See More, Think Deeper: Query-Expanded Visual Evidence and Answer-Clue Guided Reflection for Long Video Understanding