ARC-Hunyuan-Video-7B: Structured Video Comprehension of Real-World Shorts
Not on the map. Why?
Abstract (arXiv)
Real-world user-generated short videos, especially those distributed on platforms such as WeChat Channel and TikTok, dominate the mobile internet. However, current large multimodal models lack essential temporally-structured, detailed, and in-depth video comprehension capabilities, which are the cornerstone of effective video search and recommendation, as well as emerging video applications. Understanding real-world shorts is actually challenging due to their complex visual elements, high information density in both visuals and audio, and fast pacing that focuses on emotional expression and viewpoint delivery. This requires advanced reasoning to effectively integrate multimodal information, including visual, audio, and text. In this work, we introduce ARC-Hunyuan-Video, a multimodal model that processes visual, audio, and textual signals from raw video inputs end-to-end for structured comprehension. The model is capable of multi-granularity timestamped video captioning and summarization, open-ended video question answering, temporal video grounding, and video reasoning. Leveraging high-quality data from an automated annotation pipeline, our compact 7B-parameter model is trained through a comprehensive regimen: pre-training, instruction fine-tuning, cold start, reinforcement learning (RL) post-training, and final instruction fine-tuning. Quantitative evaluations on our introduced benchmark ShortVid-Bench and qualitative comparisons demonstrate its strong performance in real-world video comprehension, and it supports zero-shot or fine-tuning with a few samples for diverse downstream applications. The real-world production deployment of our model has yielded tangible and measurable improvements in user engagement and satisfaction, a success supported by its remarkable efficiency, with stress tests indicating an inference time of just 10 seconds for a one-minute video on H20 GPU.
Key facts. Cited by 36 papers in the map (data through 7 Oct 2026). Builds on 24 of its 31 references that are in the map. First posted on arXiv 28 Jul 2025.
Builds on
24 of 31 references.
References · 24
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
- 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,767
- 2025Qwen2.5-VL Technical Reportcited by 5,418
- 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 3,972
- 2024Expanding Performance Boundaries of Open-Source Multimodal Models with Model, Data, and Test-Time Scalingcited by 1,573
- 2023Video-LLaMA: An Instruction-tuned Audio-Visual Language Model for Video Understandingcited by 1,461
- 2023MVBench: A Comprehensive Multi-modal Video Understanding Benchmarkcited by 1,086
- 2023SEED-Bench: Benchmarking Multimodal LLMs with Generative Comprehensioncited by 929
- 2025Qwen2.5-Omni Technical Reportcited by 704
- 2017TALL: Temporal Activity Localization via Language Querycited by 581
12 more
- 2021CLIP2Video: Mastering Video-Text Retrieval via Image CLIPcited by 223
- 2025Video-Holmes: Can MLLM Think Like Holmes for Complex Video Reasoning?cited by 107
- 2024video-SALMONN: Speech-Enhanced Audio-Visual Large Language Modelscited by 101
- 2023Audio-Visual LLM for Video Understandingcited by 76
- 2023EgoPlan-Bench: Benchmarking Multimodal Large Language Models for Human-Level Planningcited by 66
- 2021A Survey on Accuracy-oriented Neural Recommendation: From Collaborative Filtering to Information-rich Recommendationcited by 59
- 2025Kwai Keye-VL Technical Reportcited by 47
- 2021On Semantic Similarity in Video Retrievalcited by 45
- 2025VCR-Bench: A Comprehensive Evaluation Framework for Video Chain-of-Thought Reasoningcited by 41
- 2024EgoPlan-Bench2: A Benchmark for Multimodal Large Language Model Planning in Real-World Scenarioscited by 37
- 2021Pre-trained Language Model based Ranking in Baidu Searchcited by 33
- 2025video-SALMONN-o1: Reasoning-enhanced Audio-visual Large Language Modelcited by 19
Built on by
Citing papers per year: 2025: 14; 2026: 22.
36 papers.
Sort:
By area:
- 2025Thinking With Videos: Multimodal Tool-Augmented Reinforcement Learning for Long Video Reasoningcited by 88
- 2025TimeLens: Rethinking Video Temporal Grounding with Multimodal LLMscited by 46
- 2026Video-OPD: Efficient Post-Training of Multimodal Large Language Models for Temporal Video Grounding via On-Policy Distillationcited by 32
- 2025LOVE-R1: Advancing Long Video Understanding with an Adaptive Zoom-in Mechanism via Multi-Step Reasoningcited by 27
- 2025AVoCaDO: An Audiovisual Video Captioner Driven by Temporal Orchestrationcited by 26
- 2025Streaming Video Instruction Tuningcited by 25
- 2025Video-STAR: Reinforcing Open-Vocabulary Action Recognition with Toolscited by 23
- 2026LVOmniBench: Pioneering Long Audio-Video Understanding Evaluation for Omnimodal LLMscited by 22
- 2025OmniZip: Audio-Guided Dynamic Token Compression for Fast Omnimodal Large Language Modelscited by 21
- 2025AdaTooler-V: Adaptive Tool-Use for Images and Videoscited by 20
- 2025Active Perception Agent for Omnimodal Audio-Video Understandingcited by 13
- 2026OmniVideo-R1: Reinforcing Audio-visual Reasoning with Query Intention and Modality Attentioncited by 9
24 more
- 2025Video-LMM Post-Training: A Deep Dive into Video Reasoning with Large Multimodal Modelscited by 8
- 2026TimeChat-Captioner: Scripting Multi-Scene Videos with Time-Aware and Structural Audio-Visual Captionscited by 8
- 2025Video-as-Answer: Predict and Generate Next Video Event with Joint-GRPOcited by 7
- 2026Towards Universal Video MLLMs with Attribute-Structured and Quality-Verified Instructionscited by 7
- 2026D-ORCA: Dialogue-Centric Optimization for Robust Audio-Visual Captioningcited by 6
- 2025ChronusOmni: Improving Time Awareness of Omni Large Language Modelscited by 5
- 2026OmniScript: Towards Audio-Visual Script Generation for Long-Form Cinematic Videocited by 5
- 2026OmniPack: Unified Token Compression for Efficient Omni-modal Large Language Modelscited by 3
- 2025ViDiC: Video Difference Captioningcited by 2
- 2026OmniRefine: Alignment-Aware Cooperative Compression for Efficient Omnimodal Large Language Modelscited by 2
- 2026HiVid-Narrator: Hierarchical Video Narrative Generation with Scene-Primed ASR-anchored Compressioncited by 1
- 2026Temporal and Cross-Modal Alignment for Enhanced Audiovisual Video Captioningcited by 1
- 2026AVSCap: Orchestrating Audio-Visual Synergy for Omni-modal Video Captioningcited by 1
- 2026Allocation Before Ranking: Decoupled Token Compression for OmniLLMscited by 1
- 2025Decoupling Perception from Reasoning for Hallucination-Resistant Video Understandingcited by 0
- 2026StoryTR: Narrative-Centric Video Temporal Retrieval with Theory of Mind Reasoningcited by 0
- 2026CACR:Reinforcing Temporal Answer Grounding in Instructional Video via Candidate-Aware Causal Reasoningcited by 0
- 2026Learning to Deny: Action Denial in Multimodal Large Language Modelscited by 0
- 2026Parallelized Autoregressive Decoding for Omni-Modal Dense Video Captioningcited by 0
- 2026PercepCap: Video Captioner with Structured Spatio-Temporal Perceptioncited by 0
- 2026RefCaptioner: Multi-Reference Image-Grounded Video Captioningcited by 0
- 2026AVCap: Reinforcing Audio-Video Joint Caption with Detail-Aware Rewardcited by 0
- 2026SocialReasonBench: A Video-QA Benchmark for Social Reasoning with Counterfactual Narrative Videoscited by 0
- 2026Beyond Sparse Rewards: A New Benchmark and Structure-Aware Graph Alignment for Micro-Drama Understandingcited by 0
- 2026Beyond Sparse Rewards: A New Benchmark and Structure-Aware Graph Alignment for Micro-Drama Understanding7 Sep 2026
- 2026SocialReasonBench: A Video-QA Benchmark for Social Reasoning with Counterfactual Narrative Videos31 Aug 2026
- 2026AVCap: Reinforcing Audio-Video Joint Caption with Detail-Aware Reward7 Aug 2026
- 2026OmniPack: Unified Token Compression for Efficient Omni-modal Large Language Models4 Aug 2026
- 2026Allocation Before Ranking: Decoupled Token Compression for OmniLLMs3 Aug 2026
- 2026RefCaptioner: Multi-Reference Image-Grounded Video Captioning30 Jul 2026
- 2026PercepCap: Video Captioner with Structured Spatio-Temporal Perception22 Jul 2026
- 2026AVSCap: Orchestrating Audio-Visual Synergy for Omni-modal Video Captioning14 Jul 2026
- 2026Parallelized Autoregressive Decoding for Omni-Modal Dense Video Captioning3 Jul 2026
- 2026Temporal and Cross-Modal Alignment for Enhanced Audiovisual Video Captioning2 Jul 2026
- 2026Learning to Deny: Action Denial in Multimodal Large Language Models30 Jun 2026
- 2026CACR:Reinforcing Temporal Answer Grounding in Instructional Video via Candidate-Aware Causal Reasoning7 Jun 2026
24 more
- 2026OmniRefine: Alignment-Aware Cooperative Compression for Efficient Omnimodal Large Language Models12 May 2026
- 2026StoryTR: Narrative-Centric Video Temporal Retrieval with Theory of Mind Reasoning25 Apr 2026
- 2026OmniScript: Towards Audio-Visual Script Generation for Long-Form Cinematic Video13 Apr 2026
- 2026LVOmniBench: Pioneering Long Audio-Video Understanding Evaluation for Omnimodal LLMs19 Mar 2026
- 2026Towards Universal Video MLLMs with Attribute-Structured and Quality-Verified Instructions13 Feb 2026
- 2026TimeChat-Captioner: Scripting Multi-Scene Videos with Time-Aware and Structural Audio-Visual Captions9 Feb 2026
- 2026D-ORCA: Dialogue-Centric Optimization for Robust Audio-Visual Captioning8 Feb 2026
- 2026OmniVideo-R1: Reinforcing Audio-visual Reasoning with Query Intention and Modality Attention5 Feb 2026
- 2026Video-OPD: Efficient Post-Training of Multimodal Large Language Models for Temporal Video Grounding via On-Policy Distillation3 Feb 2026
- 2026HiVid-Narrator: Hierarchical Video Narrative Generation with Scene-Primed ASR-anchored Compression12 Jan 2026
- 2025Active Perception Agent for Omnimodal Audio-Video Understanding29 Dec 2025
- 2025Streaming Video Instruction Tuning24 Dec 2025
- 2025AdaTooler-V: Adaptive Tool-Use for Images and Videos18 Dec 2025
- 2025TimeLens: Rethinking Video Temporal Grounding with Multimodal LLMs16 Dec 2025
- 2025ChronusOmni: Improving Time Awareness of Omni Large Language Models10 Dec 2025
- 2025ViDiC: Video Difference Captioning3 Dec 2025
- 2025Decoupling Perception from Reasoning for Hallucination-Resistant Video Understanding23 Nov 2025
- 2025Video-as-Answer: Predict and Generate Next Video Event with Joint-GRPO20 Nov 2025
- 2025OmniZip: Audio-Guided Dynamic Token Compression for Fast Omnimodal Large Language Models18 Nov 2025
- 2025AVoCaDO: An Audiovisual Video Captioner Driven by Temporal Orchestration12 Oct 2025
- 2025Video-STAR: Reinforcing Open-Vocabulary Action Recognition with Tools9 Oct 2025
- 2025Video-LMM Post-Training: A Deep Dive into Video Reasoning with Large Multimodal Models6 Oct 2025
- 2025LOVE-R1: Advancing Long Video Understanding with an Adaptive Zoom-in Mechanism via Multi-Step Reasoning29 Sep 2025
- 2025Thinking With Videos: Multimodal Tool-Augmented Reinforcement Learning for Long Video Reasoning6 Aug 2025
- 2025Thinking With Videos: Multimodal Tool-Augmented Reinforcement Learning for Long Video Reasoningcited by 88
- 2025TimeLens: Rethinking Video Temporal Grounding with Multimodal LLMscited by 46
- 2026Video-OPD: Efficient Post-Training of Multimodal Large Language Models for Temporal Video Grounding via On-Policy Distillationcited by 32
- 2025LOVE-R1: Advancing Long Video Understanding with an Adaptive Zoom-in Mechanism via Multi-Step Reasoningcited by 27
- 2025AdaTooler-V: Adaptive Tool-Use for Images and Videoscited by 20
- 2026OmniVideo-R1: Reinforcing Audio-visual Reasoning with Query Intention and Modality Attentioncited by 9
- 2025Video-LMM Post-Training: A Deep Dive into Video Reasoning with Large Multimodal Modelscited by 8
- 2025Video-as-Answer: Predict and Generate Next Video Event with Joint-GRPOcited by 7
- 2025Decoupling Perception from Reasoning for Hallucination-Resistant Video Understandingcited by 0
- 2026CACR:Reinforcing Temporal Answer Grounding in Instructional Video via Candidate-Aware Causal Reasoningcited by 0
- 2026CACR:Reinforcing Temporal Answer Grounding in Instructional Video via Candidate-Aware Causal Reasoning7 Jun 2026
- 2026OmniVideo-R1: Reinforcing Audio-visual Reasoning with Query Intention and Modality Attention5 Feb 2026
- 2026Video-OPD: Efficient Post-Training of Multimodal Large Language Models for Temporal Video Grounding via On-Policy Distillation3 Feb 2026
- 2025AdaTooler-V: Adaptive Tool-Use for Images and Videos18 Dec 2025
- 2025TimeLens: Rethinking Video Temporal Grounding with Multimodal LLMs16 Dec 2025
- 2025Decoupling Perception from Reasoning for Hallucination-Resistant Video Understanding23 Nov 2025
- 2025Video-as-Answer: Predict and Generate Next Video Event with Joint-GRPO20 Nov 2025
- 2025Video-LMM Post-Training: A Deep Dive into Video Reasoning with Large Multimodal Models6 Oct 2025
- 2025LOVE-R1: Advancing Long Video Understanding with an Adaptive Zoom-in Mechanism via Multi-Step Reasoning29 Sep 2025
- 2025Thinking With Videos: Multimodal Tool-Augmented Reinforcement Learning for Long Video Reasoning6 Aug 2025
- 2025OmniZip: Audio-Guided Dynamic Token Compression for Fast Omnimodal Large Language Modelscited by 21
- 2026OmniPack: Unified Token Compression for Efficient Omni-modal Large Language Modelscited by 3
- 2026Allocation Before Ranking: Decoupled Token Compression for OmniLLMscited by 1
- 2026Parallelized Autoregressive Decoding for Omni-Modal Dense Video Captioningcited by 0
- 2026OmniPack: Unified Token Compression for Efficient Omni-modal Large Language Models4 Aug 2026
- 2026Allocation Before Ranking: Decoupled Token Compression for OmniLLMs3 Aug 2026
- 2026Parallelized Autoregressive Decoding for Omni-Modal Dense Video Captioning3 Jul 2026
- 2025OmniZip: Audio-Guided Dynamic Token Compression for Fast Omnimodal Large Language Models18 Nov 2025
- 2025Video-STAR: Reinforcing Open-Vocabulary Action Recognition with Toolscited by 23
- 2026OmniScript: Towards Audio-Visual Script Generation for Long-Form Cinematic Videocited by 5
- 2026Temporal and Cross-Modal Alignment for Enhanced Audiovisual Video Captioningcited by 1
- 2026Learning to Deny: Action Denial in Multimodal Large Language Modelscited by 0
- 2026Temporal and Cross-Modal Alignment for Enhanced Audiovisual Video Captioning2 Jul 2026
- 2026Learning to Deny: Action Denial in Multimodal Large Language Models30 Jun 2026
- 2026OmniScript: Towards Audio-Visual Script Generation for Long-Form Cinematic Video13 Apr 2026
- 2025Video-STAR: Reinforcing Open-Vocabulary Action Recognition with Tools9 Oct 2025
- 2025AVoCaDO: An Audiovisual Video Captioner Driven by Temporal Orchestrationcited by 26
- 2025Streaming Video Instruction Tuningcited by 25
- 2026LVOmniBench: Pioneering Long Audio-Video Understanding Evaluation for Omnimodal LLMscited by 22
- 2026TimeChat-Captioner: Scripting Multi-Scene Videos with Time-Aware and Structural Audio-Visual Captionscited by 8
- 2026Towards Universal Video MLLMs with Attribute-Structured and Quality-Verified Instructionscited by 7
- 2026D-ORCA: Dialogue-Centric Optimization for Robust Audio-Visual Captioningcited by 6
- 2025ChronusOmni: Improving Time Awareness of Omni Large Language Modelscited by 5
- 2025ViDiC: Video Difference Captioningcited by 2
- 2026OmniRefine: Alignment-Aware Cooperative Compression for Efficient Omnimodal Large Language Modelscited by 2
- 2026HiVid-Narrator: Hierarchical Video Narrative Generation with Scene-Primed ASR-anchored Compressioncited by 1
- 2026AVSCap: Orchestrating Audio-Visual Synergy for Omni-modal Video Captioningcited by 1
- 2026StoryTR: Narrative-Centric Video Temporal Retrieval with Theory of Mind Reasoningcited by 0
12 most cited of 17 All 17 (JSON)
- 2026Beyond Sparse Rewards: A New Benchmark and Structure-Aware Graph Alignment for Micro-Drama Understanding7 Sep 2026
- 2026SocialReasonBench: A Video-QA Benchmark for Social Reasoning with Counterfactual Narrative Videos31 Aug 2026
- 2026AVCap: Reinforcing Audio-Video Joint Caption with Detail-Aware Reward7 Aug 2026
- 2026RefCaptioner: Multi-Reference Image-Grounded Video Captioning30 Jul 2026
- 2026PercepCap: Video Captioner with Structured Spatio-Temporal Perception22 Jul 2026
- 2026AVSCap: Orchestrating Audio-Visual Synergy for Omni-modal Video Captioning14 Jul 2026
- 2026OmniRefine: Alignment-Aware Cooperative Compression for Efficient Omnimodal Large Language Models12 May 2026
- 2026StoryTR: Narrative-Centric Video Temporal Retrieval with Theory of Mind Reasoning25 Apr 2026
- 2026LVOmniBench: Pioneering Long Audio-Video Understanding Evaluation for Omnimodal LLMs19 Mar 2026
- 2026Towards Universal Video MLLMs with Attribute-Structured and Quality-Verified Instructions13 Feb 2026
- 2026TimeChat-Captioner: Scripting Multi-Scene Videos with Time-Aware and Structural Audio-Visual Captions9 Feb 2026
- 2026D-ORCA: Dialogue-Centric Optimization for Robust Audio-Visual Captioning8 Feb 2026
12 newest of 17 All 17 (JSON)
Similar, not cited
Close in wording, no citation either way
- 2024TemporalBench: Benchmarking Fine-grained Temporal Understanding for Multimodal Video Models
- 2025Toward Scalable Video Narration: A Training-free Approach Using Multimodal Large Language Models
- 2024Video-RAG: Visually-aligned Retrieval-Augmented Long Video Comprehension
- 2024LongVideoBench: A Benchmark for Long-context Interleaved Video-Language Understanding
- 2023Long Story Short: a Summarize-then-Search Method for Long Video Question Answering
- 2026MMOU: A Massive Multi-Task Omni Understanding and Reasoning Benchmark for Long and Complex Real-World Videos
- 2024StreamingBench: Assessing the Gap for MLLMs to Achieve Streaming Video Understanding
- 2024MMBench-Video: A Long-Form Multi-Shot Benchmark for Holistic Video Understanding