Comics Datasets Framework: Mix of Comics datasets for detection benchmarking
Not on the map. Why?
Abstract (arXiv)
Comics, as a medium, uniquely combine text and images in styles often distinct from real-world visuals. For the past three decades, computational research on comics has evolved from basic object detection to more sophisticated tasks. However, the field faces persistent challenges such as small datasets, inconsistent annotations, inaccessible model weights, and results that cannot be directly compared due to varying train/test splits and metrics. To address these issues, we aim to standardize annotations across datasets, introduce a variety of comic styles into the datasets, and establish benchmark results with clear, replicable settings. Our proposed Comics Datasets Framework standardizes dataset annotations into a common format and addresses the overrepresentation of manga by introducing Comics100, a curated collection of 100 books from the Digital Comics Museum, annotated for detection in our uniform format. We have benchmarked a variety of detection architectures using the Comics Datasets Framework. All related code, model weights, and detailed evaluation processes are available at https://github.com/emanuelevivoli/cdf, ensuring transparency and facilitating replication. This initiative is a significant advancement towards improving object detection in comics, laying the groundwork for more complex computational tasks dependent on precise object recognition.
Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Builds on 9 of its 29 references that are in the map. First posted on arXiv 3 Jul 2024.
Builds on
9 of 29 references.
References · 9
- 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,332
- 2022Relationformer: A Unified Framework for Image-to-Graph Generationcited by 67
- 2016The Amazing Mysteries of the Gutter: Drawing Inferences Between Panels in Comic Book Narrativescited by 42
- 2024The Manga Whisperer: Automatically Generating Transcriptions for Comicscited by 21
- 2018Object Detection for Comics using Manga109 Annotationscited by 14
- 2023Manga109Dialog: A Large-scale Dialogue Dataset for Comics Speaker Detectioncited by 14
- 2022COO: Comic Onomatopoeia Dataset for Recognizing Arbitrary or Truncated Textscited by 13
- 2024Multimodal Transformer for Comics Text-Clozecited by 5
- 2019Deep CNN-based Speech Balloon Detection and Segmentation for Comic Bookscited by 4
Built on by
Citing papers per year: 2024: 3; 2025: 4.
7 papers.
- 2024CoMix: A Comprehensive Benchmark for Multi-Task Comic Understandingcited by 16
- 2024MangaUB: A Manga Understanding Benchmark for Large Multimodal Modelscited by 8
- 2025ComicsPAP: understanding comic strips by picking the correct panelcited by 5
- 2025From Panels to Prose: Generating Literary Narratives from Comicscited by 5
- 2024ComiCap: A VLMs pipeline for dense captioning of Comic Panelscited by 3
- 2025CoSMo: A Multimodal Transformer for Page Stream Segmentation in Comic Bookscited by 2
- 2025Zooming into Comics: Region-Aware RL Improves Fine-Grained Comic Understanding in Vision-Language Modelscited by 1
- 2025Zooming into Comics: Region-Aware RL Improves Fine-Grained Comic Understanding in Vision-Language Models9 Nov 2025
- 2025CoSMo: A Multimodal Transformer for Page Stream Segmentation in Comic Books14 Jul 2025
- 2025From Panels to Prose: Generating Literary Narratives from Comics30 Mar 2025
- 2025ComicsPAP: understanding comic strips by picking the correct panel11 Mar 2025
- 2024ComiCap: A VLMs pipeline for dense captioning of Comic Panels24 Sep 2024
- 2024MangaUB: A Manga Understanding Benchmark for Large Multimodal Models26 Jul 2024
- 2024CoMix: A Comprehensive Benchmark for Multi-Task Comic Understanding4 Jul 2024