FCMBench-Video: Benchmarking Document Video Intelligence
Not on the map. Why?
Abstract (arXiv)
Document understanding is a critical capability in financial credit review, onboarding, and remote verification, where both decision accuracy and evidence traceability matter. Compared with static document images, document videos present a temporally redundant and sequentially unfolding evidence stream, require evidence integration across frames, and preserve acquisition-process cues relevant to authenticity-sensitive and anti-fraud review. We introduce FCMBench-Video, a benchmark for document-video intelligence that evaluates document perception, temporal grounding, and evidence-grounded reasoning under realistic capture conditions. For privacy-compliant yet realistic data at scale, we organize construction as an atomic-acquisition and composition workflow that records reusable single-document clips, applies controlled degradations, and assembles long-form multi-document videos with prescribed temporal spans. FCMBench-Video is built from 495 atomic videos composed into 1,200 long-form videos paired with 11,322 expert-annotated question--answer instances, covering 28 document types over 20s--60s duration tiers and 5,960 Chinese / 5,362 English instances. Evaluations on nine recent Video-MLLMs show that FCMBench-Video provides meaningful separation across systems and capabilities: counting is the most duration-sensitive task, Cross-Document Validation and Evidence-Grounded Selection probe higher-level evidence integration, and Visual Prompt Injection provides a complementary robustness dimension. The overall score distribution is broad and approximately bell-shaped, indicating a benchmark that is neither saturated nor dominated by trivial cases. Together, these results position FCMBench-Video as a reproducible benchmark for tracking Video-MLLM progress on document-video understanding and probing capability boundaries in authenticity-sensitive credit-domain applications.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 11 of its 16 references that are in the map. First posted on arXiv 28 Apr 2026.
Builds on
11 of 16 references.
References · 11
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2025Qwen3-VL Technical Reportcited by 2,793
- 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,834
- 2024Video-MME: The First-Ever Comprehensive Evaluation Benchmark of Multi-modal LLMs in Video Analysiscited by 1,413
- 2020DocVQA: A Dataset for VQA on Document Imagescited by 1,317
- 2023MVBench: A Comprehensive Multi-modal Video Understanding Benchmarkcited by 1,109
- 2025Kimi-VL Technical Reportcited by 388
- 2019FUNSD: A Dataset for Form Understanding in Noisy Scanned Documentscited by 349
- 2021ICDAR2019 Competition on Scanned Receipt OCR and Information Extractioncited by 256
- 2025Video-MMMU: Evaluating Knowledge Acquisition from Multi-Discipline Professional Videoscited by 236
- 2025Ovis2.5 Technical Reportcited by 108
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026TRACE: Evidence Grounding-Guided Multi-Video Event Understanding and Claim Generation
- 2026VideoSlate: Stateful Commit Control for Temporally Grounded Agentic Video Reasoning
- 2026FCMBench: The First Large-scale Financial Credit Multimodal Benchmark for Real-world Applications
- 2026Catching Hallucinated Citations in Video-LLM Question Answering: A Self-Verification Pipeline and Verifier Ablation Study
- 2026Video-HOCA: A Diagnostic Benchmark for Physical Anomaly Reasoning in Video-LLMs
- 2026Video-Index: A Curated Meta-Benchmark for Video Understanding
- 2026VELD-QA: A Large-Scale Dataset for Visual Evidence Grounding and Question Answering in Long Documents
- 2026GPT4o-Receipt: A Dataset and Human Study for AI-Generated Document Forensics