mlsanityData to 7 Oct 2026

LLM-Guided Semantic Relational Reasoning for Multimodal Intent Recognition

arXiv 2509.01337 ↗First posted 1 Sep 2025cs.MM cs.AI cs.CLcited by 3

On the map: LLM reasoning → Multimodal reasoning

Abstract (arXiv)

Understanding human intents from multimodal signals is critical for analyzing human behaviors and enhancing human-machine interactions in real-world scenarios. However, existing methods exhibit limitations in their modality-level reliance, constraining relational reasoning over fine-grained semantics for complex intent understanding. This paper proposes a novel LLM-Guided Semantic Relational Reasoning (LGSRR) method, which harnesses the expansive knowledge of large language models (LLMs) to establish semantic foundations that boost smaller models' relational reasoning performance. Specifically, an LLM-based strategy is proposed to extract fine-grained semantics as guidance for subsequent reasoning, driven by a shallow-to-deep Chain-of-Thought (CoT) that autonomously uncovers, describes, and ranks semantic cues by their importance without relying on manually defined priors. Besides, we formally model three fundamental types of semantic relations grounded in logical principles and analyze their nuanced interplay to enable more effective relational reasoning. Extensive experiments on multimodal intent and dialogue act recognition tasks demonstrate LGSRR's superiority over state-of-the-art methods, with consistent performance gains across diverse semantic understanding scenarios. The complete data and code are available at https://github.com/thuiar/LGSRR.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 11 of its 54 references that are in the map. First posted on arXiv 1 Sep 2025.

Builds on

11 of 54 references.

Closest ancestors · 1

Same direction, newest first

  1. 2023MM-REACT: Prompting ChatGPT for Multimodal Reasoning and Action20 Mar

Other references · 10

  1. 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,151
  2. 2024MiniCPM-V: A GPT-4V Level MLLM on Your Phonecited by 1,061
  3. 2023VideoChat: Chat-Centric Video Understandingcited by 851
  4. 2024VideoLLaMA 2: Advancing Spatial-Temporal Modeling and Audio Understanding in Video-LLMscited by 749
  5. 2017Tensor Fusion Network for Multimodal Sentiment Analysiscited by 429
  6. 2023A Comprehensive Survey on Pretrained Foundation Models: A History from BERT to ChatGPTcited by 364
  7. 2018Efficient Low-rank Multimodal Fusion with Modality-Specific Factorscited by 268
  8. 2024MiniGPT4-Video: Advancing Multimodal LLMs for Video Understanding with Interleaved Visual-Textual Tokenscited by 116
  9. 2021NeuralNDCG: Direct Optimisation of a Ranking Metric via Differentiable Relaxation of Sortingcited by 39
  10. 2024Multimodal Classification and Out-of-distribution Detection for Multimodal Intent Understandingcited by 6

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 3.

3 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Evolutionary Multimodal Reasoning via Hierarchical Semantic Representation for Intent Recognition
  2. 2026Unsupervised Multimodal Intent Discovery via MLLM-Guided Concept Generation and Semantic Propagation ↗
  3. 2025LLM+AL: Bridging Large Language Models and Action Languages for Complex Reasoning about Actions
  4. 2025Multimodal Behavioral Patterns Analysis with Eye-Tracking and LLM-Based Reasoning
  5. 2025HumanOmniV2: From Understanding to Omni-Modal Reasoning with Context
  6. 2025Chain of Questions: Guiding Multimodal Curiosity in Language Models
  7. 2026SciReC: Diagnostic Evaluation of Multimodal, Multi-Turn Relational Reasoning with Adaptive Interaction
  8. 2025Perception, Reason, Think, and Plan: A Survey on Large Multimodal Reasoning Models