mlsanityData to 7 Oct 2026

LongEmo: Towards Emotion Understanding and Reasoning in Long Videos

arXiv 2609.40079 ↗First posted 30 Sep 2026cs.CV cs.AIcited by 0

On the map: LLM reasoning → Audio-language model reasoning

also in 1 more
Abstract (arXiv)

While recent Multimodal Large Language Models (MLLMs) have shown promise in affective computing, their reasoning capabilities are largely confined to short video clips with limited interactions. However, real-world emotions are not merely isolated instantaneous reactions but dynamic and cumulative processes deeply shaped by past experiences and ongoing events. To bridge this gap, we introduce LongEmoBench, a benchmark dedicated to emotion understanding and reasoning in long videos. It assesses progressive capabilities scaling from continuous scene interactions to complex episodic developments. Furthermore, we propose LongEmo, a novel memory-augmented agentic framework designed to tackle the immense challenges of long-range affective reasoning. LongEmo processes continuous video streams to construct an Event Memory Graph, explicitly modeling long-range dependencies and capturing emotional dynamics across discrete events. Given a question, the agent retrieves a query-relevant event stream from the graph, iteratively integrating multimodal memories and relational dependencies to deduce the final answer. Extensive evaluations of 17 representative methods reveal that they struggle significantly with emotion understanding and reasoning in long videos. In contrast, LongEmo achieves state-of-the-art performance, demonstrating the efficacy of its event-centric memory architecture.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Audio-language model reasoning, one of 17 directions in LLM reasoning. Builds on 25 of its 34 references that are in the map. First posted on arXiv 30 Sep 2026.

Builds on

25 of 34 references.

Closest ancestors · 3

Same direction, newest first

  1. 2026EmoTrans: A Benchmark for Understanding, Reasoning, and Predicting Emotion Transitions in Multimodal LLMs25 Apr
  2. 2025VidEmo: Affective-Tree Reasoning for Emotion-Centric Video Foundation Models4 Nov
  3. 2025Beyond Emotion Recognition: A Multi-Turn Multimodal Emotion Understanding and Reasoning Benchmark23 Aug

Other references · 22

  1. 2023Efficient Streaming Language Models with Attention Sinkscited by 2,115
  2. 2024Video-MME: The First-Ever Comprehensive Evaluation Benchmark of Multi-modal LLMs in Video Analysiscited by 1,375
  3. 2026DeepSeek-V4: Towards Highly Efficient Million-Token Context Intelligencecited by 877
  4. 2024LVBench: An Extreme Long Video Understanding Benchmarkcited by 402
  5. 2024VideoChat-Flash: Hierarchical Compression for Long-Context Video Modelingcited by 212
  6. 2025R1-Omni: Explainable Omni-Multimodal Emotion Recognition with Reinforcement Learningcited by 99
  7. 2025Seeing, Listening, Remembering, and Reasoning: A Multimodal Agent with Long-Term Memorycited by 88
  8. 2025Flash-VStream: Efficient Real-Time Understanding for Long Video Streamscited by 78
  9. 2020Context Based Emotion Recognition using EMOTIC Datasetcited by 73
  10. 2025HumanOmni: A Large Vision-Speech Language Model for Human-Centric Video Understandingcited by 58
  11. 2025WorldMM: Dynamic Multimodal Memory Agent for Long Video Reasoningcited by 50
  12. 2025AffectGPT: A New Dataset, Model, and Benchmark for Emotion Understanding with Multimodal Large Language Modelscited by 43
10 more
  1. 2025EmoBench-M: Benchmarking Emotional Intelligence for Multimodal Large Language Modelscited by 32
  2. 2024MERBench: A Unified Evaluation Benchmark for Multimodal Emotion Recognitioncited by 27
  3. 2024OV-MER: Towards Open-Vocabulary Multimodal Emotion Recognitioncited by 17
  4. 2025MME-Emotion: A Holistic Evaluation Benchmark for Emotional Intelligence in Multimodal Large Language Modelscited by 17
  5. 2026Think, Then Verify: A Hypothesis-Verification Multi-Agent Framework for Long Video Understandingcited by 8
  6. 2026Speak While Watching: Unleashing TRUE Real-Time Video Understanding Capability of Multimodal Large Language Modelscited by 7
  7. 2025Akan Cinematic Emotions (ACE): A Multimodal Multi-party Dataset for Emotion Recognition in Movie Dialoguescited by 6
  8. 2026AVOC: Enhancing Hour-Level Audio-Video Understanding in Omni-Modal LLMs via Retrieval-Inspired Token Compressioncited by 2
  9. 2026OmniFocus: Query-Guided Modality-Balanced Token Compression for Omni-Modal Large Language Modelscited by 2
  10. 2026Light-Omni: Reflex over Reasoning in Agentic Video Understanding with Long-Term Memorycited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026OneEmo: A Unified Multimodal Reasoning Model for Emotion Perception, Understanding, and Interaction
  2. 2025LongEmotion: Measuring Emotional Intelligence of Large Language Models in Long-Context Interaction
  3. 2026AffectSeek: Agentic Affective Understanding in Long Videos under Vague User Queries
  4. 2024StimuVAR: Spatiotemporal Stimuli-aware Video Affective Reasoning with Multimodal Large Language Models
  5. 2026Unveiling the Cognitive Compass: Theory-of-Mind-Guided Multimodal Emotion Reasoning
  6. 2025Emotion-Qwen: A Unified Framework for Emotion and Vision Understanding
  7. 2025Why We Feel: Breaking Boundaries in Emotional Reasoning with Multimodal Large Language Models
  8. 2025Emotion-o1: Adaptive Long Reasoning for Emotion Understanding in LLMs