CoSMo: A Multimodal Transformer for Page Stream Segmentation in Comic Books
Not on the map. Why?
Abstract (arXiv)
This paper introduces CoSMo, a novel multimodal Transformer for Page Stream Segmentation (PSS) in comic books, a critical task for automated content understanding, as it is a necessary first stage for many downstream tasks like character analysis, story indexing, or metadata enrichment. We formalize PSS for this unique medium and curate a new 20,800-page annotated dataset. CoSMo, developed in vision-only and multimodal variants, consistently outperforms traditional baselines and significantly larger general-purpose vision-language models across F1-Macro, Panoptic Quality, and stream-level metrics. Our findings highlight the dominance of visual features for comic PSS macro-structure, yet demonstrate multimodal benefits in resolving challenging ambiguities. CoSMo establishes a new state-of-the-art, paving the way for scalable comic book analysis.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 12 of its 17 references that are in the map. First posted on arXiv 14 Jul 2025.
Builds on
12 of 17 references.
References · 12
- 2025Qwen3 Embedding: Advancing Text Embedding and Reranking Through Foundation Modelscited by 1,175
- 2018Panoptic Segmentationcited by 796
- 2016The Amazing Mysteries of the Gutter: Drawing Inferences Between Panels in Comic Book Narrativescited by 41
- 2024The Manga Whisperer: Automatically Generating Transcriptions for Comicscited by 20
- 2024CoMix: A Comprehensive Benchmark for Multi-Task Comic Understandingcited by 15
- 2024Tails Tell Tales: Chapter-Wide Manga Transcriptions with Character Namescited by 10
- 2024One missing piece in Vision and Language: A Survey on Comics Understandingcited by 8
- 2024Comics Datasets Framework: Mix of Comics datasets for detection benchmarkingcited by 7
- 2017Page Stream Segmentation with Convolutional Neural Nets Combining Textual and Visual Featurescited by 5
- 2024Multimodal Transformer for Comics Text-Clozecited by 5
- 2024Large Language Models for Page Stream Segmentationcited by 5
- 2022Semantic Parsing of Interpage Relationscited by 4
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2024ComiCap: A VLMs pipeline for dense captioning of Comic Panels
- 2025Zooming into Comics: Region-Aware RL Improves Fine-Grained Comic Understanding in Vision-Language Models
- 2025ComicsPAP: understanding comic strips by picking the correct panel
- 2025From Panels to Prose: Generating Literary Narratives from Comics
- 2023CogCartoon: Towards Practical Story Visualization
- 2025MangaVQA and MangaLMM: A Benchmark and Specialized Model for Multimodal Manga Understanding
- 2023Comics for Everyone: Generating Accessible Text Descriptions for Comic Strips
- 2024MangaUB: A Manga Understanding Benchmark for Large Multimodal Models