mlsanityData to 14 Oct 2026

Zooming into Comics: Region-Aware RL Improves Fine-Grained Comic Understanding in Vision-Language Models

arXiv 2511.06490 ↗First posted 9 Nov 2025cs.CV cs.AIcited by 1

On the map: Multimodal LLMs / vision-language models → VLM benchmarks and visual reasoning

Abstract (arXiv)

Complex visual narratives, such as comics, present a significant challenge to Vision-Language Models (VLMs). Despite excelling on natural images, VLMs often struggle with stylized line art, onomatopoeia, and densely packed multi-panel layouts. To address this gap, we introduce AI4VA-FG, the first fine-grained and comprehensive benchmark for VLM-based comic understanding. It spans tasks from foundational recognition and detection to high-level character reasoning and narrative construction, supported by dense annotations for characters, poses, and depth. Beyond that, we evaluate state-of-the-art proprietary models, including GPT-4o and Gemini-2.5, and open-source models such as Qwen2.5-VL, revealing substantial performance deficits across core tasks of our benchmarks and underscoring that comic understanding remains an unsolved challenge. To enhance VLMs' capabilities in this domain, we systematically investigate post-training strategies, including supervised fine-tuning on solutions (SFT-S), supervised fine-tuning on reasoning trajectories (SFT-R), and reinforcement learning (RL). Beyond that, inspired by the emerging "Thinking with Images" paradigm, we propose Region-Aware Reinforcement Learning (RARL) for VLMs, which trains models to dynamically attend to relevant regions through zoom-in operations. We observe that when applied to the Qwen2.5-VL model, RL and RARL yield significant gains in low-level entity recognition and high-level storyline ordering, paving the way for more accurate and efficient VLM applications in the comics domain.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in VLM benchmarks and visual reasoning, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 22 of its 25 references that are in the map. First posted on arXiv 9 Nov 2025.

Builds on

22 of 25 references.

Closest ancestors · 2

Same direction, newest first

  1. 2025Reinforcing VLMs to Use Tools for Detailed Visual Reasoning Under Resource Constraints10 Jun
  2. 2024Visual CoT: Advancing Multi-Modal Language Models with a Comprehensive Dataset and Benchmark for Chain-of-Thought Reasoning25 Mar

Other references · 20

  1. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  2. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
  3. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
  4. 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
  5. 2023MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGIcited by 2,080
  6. 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,834
  7. 2025SFT Memorizes, RL Generalizes: A Comparative Study of Foundation Model Post-trainingcited by 672
  8. 2024BLINK: Multimodal Large Language Models Can See but Not Perceivecited by 550
  9. 2025Visual-RFT: Visual Reinforcement Fine-Tuningcited by 513
  10. 2025DeepEyes: Incentivizing "Thinking with Images" via Reinforcement Learningcited by 410
  11. 2025Pixel Reasoner: Incentivizing Pixel-Space Reasoning with Curiosity-Driven Reinforcement Learningcited by 278
  12. 2025Adaptive Chain-of-Focus Reasoning via Dynamic Visual Search and Zooming for Efficient VLMscited by 96
8 more
  1. 2024CoMix: A Comprehensive Benchmark for Multi-Task Comic Understandingcited by 16
  2. 2025Scalpel vs. Hammer: GRPO Amplifies Existing Capabilities, SFT Replaces Themcited by 15
  3. 2024MangaUB: A Manga Understanding Benchmark for Large Multimodal Modelscited by 8
  4. 2024Comics Datasets Framework: Mix of Comics datasets for detection benchmarkingcited by 7
  5. 2025MangaVQA and MangaLMM: A Benchmark and Specialized Model for Multimodal Manga Understandingcited by 7
  6. 2025ComicsPAP: understanding comic strips by picking the correct panelcited by 5
  7. 2025Beyond Single Frames: Can LMMs Comprehend Temporal and Contextual Narratives in Image Sequences?cited by 4
  8. 2024Unlocking Comics: The AI4VA Dataset for Visual Understandingcited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2024One missing piece in Vision and Language: A Survey on Comics Understanding
  2. 2024ComiCap: A VLMs pipeline for dense captioning of Comic Panels
  3. 2025From Panels to Prose: Generating Literary Narratives from Comics
  4. 2025Re:Verse -- Can Your VLM Read a Manga?
  5. 2025When 'YES' Meets 'BUT': Can Large Models Comprehend Contradictory Humor Through Comparative Reasoning?
  6. 2025CoSMo: A Multimodal Transformer for Page Stream Segmentation in Comic Books
  7. 2023Comics for Everyone: Generating Accessible Text Descriptions for Comic Strips
  8. 2024Multimodal Transformer for Comics Text-Cloze