Robust Symbolic Reasoning for Visual Narratives via Hierarchical and Semantically Normalized Knowledge Graphs
On the map: LLM reasoning → Reasoning benchmarks and evaluation
Abstract (arXiv)
Understanding visual narratives such as comics requires structured representations that capture events, characters, and their relations across multiple levels of story organization. However, symbolic narrative graphs often suffer from inconsistency and redundancy, where similar actions or events are labeled differently across annotations or contexts. Such variance limits the effectiveness of reasoning and generalization. This paper introduces a semantic normalization framework for hierarchical narrative knowledge graphs. Building on cognitively grounded models of narrative comprehension, we propose methods that consolidate semantically related actions and events using lexical similarity and embedding-based clustering. The normalization process reduces annotation noise, aligns symbolic categories across narrative levels, and preserves interpretability. We demonstrate the framework on annotated manga stories from the Manga109 dataset, applying normalization to panel-, event-, and story-level graphs. Preliminary evaluations across narrative reasoning tasks, such as action retrieval, character grounding, and event summarization, show that semantic normalization improves coherence and robustness, while maintaining symbolic transparency. These findings suggest that normalization is a key step toward scalable, cognitively inspired graph models for multimodal narrative understanding.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Reasoning benchmarks and evaluation, one of 17 directions in LLM reasoning. Builds on 17 of its 40 references that are in the map. First posted on arXiv 20 Aug 2025.
Builds on
17 of 40 references.
References · 17
- 2016SQuAD: 100,000+ Questions for Machine Comprehension of Textcited by 4,115
- 2017The NarrativeQA Reading Comprehension Challengecited by 590
- 2016A Corpus and Evaluation Framework for Deeper Understanding of Commonsense Storiescited by 413
- 2015MovieQA: Understanding Stories in Movies through Question-Answeringcited by 304
- 2018Neural-Symbolic VQA: Disentangling Reasoning from Vision and Language Understandingcited by 304
- 2020Probing Pretrained Language Models for Lexical Semanticscited by 156
- 2022A Survey of Knowledge Graph Reasoning on Graph Types: Static, Dynamic, and Multimodalcited by 106
- 2022Fantastic Questions and Where to Find Them: FairytaleQA -- An Authentic Dataset for Narrative Comprehensioncited by 79
- 2017Event Representations for Automated Story Generation with Deep Neural Netscited by 62
- 2020DramaQA: Character-Centered Video Story Understanding with Hierarchical QAcited by 45
- 2019Knowledge-Enriched Visual Storytellingcited by 26
- 2023Large language models can segment narrative events similarly to humanscited by 16
5 more
- 2021Calibrating Concepts and Operations: Towards Symbolic Reasoning on Real Imagescited by 14
- 2022A survey on knowledge-enhanced multimodal learningcited by 11
- 2024Collaborative Comic Generation: Integrating Visual Narrative Theories with AI Models for Enhanced Creativitycited by 6
- 2025Hierarchical Knowledge Graphs for Story Understanding in Visual Narrativescited by 5
- 2023A Customizable Generator for Comic-Style Visual Narrativecited by 4
Built on by
Citing papers per year: 2025: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2025Re:Verse -- Can Your VLM Read a Manga?
- 2026Planning Beyond Text: Graph-based Reasoning for Complex Narrative Generation
- 2024StoryWeaver: A Unified World Model for Knowledge-Enhanced Story Character Customization
- 2024EventGround: Narrative Reasoning by Grounding to Eventuality-centric Knowledge Graphs
- 2026Narrative Knowledge Weaver: Narrative-Centric Retrieval-Augmented Reasoning for Long-Form Text Understanding
- 2026MMCOMET: A Large-Scale Multimodal Commonsense Knowledge Graph for Contextual Reasoning
- 2025MangaVQA and MangaLMM: A Benchmark and Specialized Model for Multimodal Manga Understanding
- 2024One missing piece in Vision and Language: A Survey on Comics Understanding