Towards Faithful Reasoning in Comics for Small MLLMs
On the map: LLM reasoning → Multimodal reasoning
Abstract (arXiv)
Comic understanding presents a significant challenge for Multimodal Large Language Models (MLLMs), as the intended meaning of a comic often emerges from the joint interpretation of visual, textual, and social cues. This naturally motivates Chain-of-Thought (CoT) prompting, since explicit intermediate reasoning appears promising for integrating such heterogeneous signals. However, existing CoT methods are poorly matched to this structure: they tend to force interpretation into a single reasoning path before multiple cues have been jointly considered, often degrading performance, especially for small MLLMs. Our key idea is to explicitly preserve multi-cue interpretation during supervision construction, rather than collapsing comic understanding into a single reasoning chain. To this end, we propose a two-stage framework for faithful comic reasoning in small MLLMs. First, we introduce MoCoT, a modular supervision construction framework that preserves multi-cue interpretation and turns it into more faithful supervision. Second, we propose VERA, a structured reward mechanism that turns such supervision into faithful reasoning behavior by aligning optimization with both reasoning faithfulness and answer correctness. Extensive experiments on five benchmarks spanning comic understanding and broader humor-centric and abstract visual reasoning tasks demonstrate that our framework achieves strong results in the ≤ 4B regime, surpasses several 7B baselines, improves four small MLLMs by an average of 12.1% as a plug-in, and consistently enhances reasoning faithfulness while preserving inference efficiency.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 18 of its 39 references that are in the map. First posted on arXiv 6 Jan 2026.
Builds on
18 of 39 references.
Closest ancestors · 8
Same direction, newest first
- 2025Multimodal Mathematical Reasoning with Diverse Solving Perspective3 Jul
- 2025Let Androids Dream of Electric Sheep: A Human-Inspired Image Implication Understanding and Reasoning Framework22 May
- 2025Perception, Reason, Think, and Plan: A Survey on Large Multimodal Reasoning Models8 May
- 2025When 'YES' Meets 'BUT': Can Large Models Comprehend Contradictory Humor Through Comparative Reasoning?29 Mar
- 2025Multimodal Chain-of-Thought Reasoning: A Comprehensive Survey16 Mar
- 2025Vision-R1: Incentivizing Reasoning Capability in Multimodal Large Language Models9 Mar
- 2025Unlocking Multimodal Mathematical Reasoning via Process Reward Model8 Jan
- 2024Expanding Performance Boundaries of Open-Source Multimodal Models with Model, Data, and Test-Time Scaling6 Dec
Other references · 10
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
- 2024GPT-4o System Cardcited by 4,588
- 2023Improved Baselines with Visual Instruction Tuningcited by 4,418
- 2024Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phonecited by 1,917
- 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,834
- 2024InternLM-XComposer-2.5: A Versatile Large Vision Language Model Supporting Long-Contextual Input and Outputcited by 195
- 2024Ovis: Structural Embedding Alignment for Multimodal Large Language Modelcited by 169
- 2023Question Decomposition Improves the Faithfulness of Model-Generated Reasoningcited by 108
- 2024Mono-InternVL: Pushing the Boundaries of Monolithic Multimodal Large Language Models with Endogenous Visual Pre-trainingcited by 82
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Thinking with Comics: Enhancing Multimodal Reasoning through Structured Visual Storytelling
- 2026Attention-guided Fine-tuning of Multimodal Large Language Models Improves Chain-of-Thought Reasoning
- 2026CaRGo-T: Causal Reasoning Graph-of-Thought improves Multimodal Humor Comprehension
- 2026Faithful-MR1: Faithful Multimodal Reasoning via Anchoring and Reinforcing Visual Attention
- 2025HUMORCHAIN: Theory-Guided Multi-Stage Reasoning for Interpretable Multimodal Humor Generation
- 2025Point-RFT: Improving Multimodal Reasoning with Visually Grounded Reinforcement Finetuning
- 2026Reasoning Beyond Literal: Cross-style Multimodal Reasoning for Figurative Language Understanding
- 2025ImageChain: Advancing Sequential Image-to-Text Reasoning in Multimodal Large Language Models