Building a Manga Dataset "Manga109" with Annotations for Multimedia Applications
Not on the map. Why?
Abstract (arXiv)
Manga, or comics, which are a type of multimodal artwork, have been left behind in the recent trend of deep learning applications because of the lack of a proper dataset. Hence, we built Manga109, a dataset consisting of a variety of 109 Japanese comic books (94 authors and 21,142 pages) and made it publicly available by obtaining author permissions for academic use. We carefully annotated the frames, speech texts, character faces, and character bodies; the total number of annotations exceeds 500k. This dataset provides numerous manga images and annotations, which will be beneficial for use in machine learning algorithms and their evaluation. In addition to academic use, we obtained further permission for a subset of the dataset for industrial use. In this article, we describe the details of the dataset and present a few examples of multimedia processing applications (detection, retrieval, and generation) that apply existing deep learning methods and are made possible by the dataset.
Key facts. Cited by 37 papers in the map (data through 7 Oct 2026). First posted on arXiv 9 May 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 5; 2022: 4; 2023: 6; 2024: 9; 2025: 7; 2026: 6.
37 papers.
Sort:
By area:
- 2021Transformer for Single Image Super-Resolutioncited by 150
- 2024The Manga Whisperer: Automatically Generating Transcriptions for Comicscited by 20
- 2023Unleashing the Power of Self-Supervised Image Denoising: A Comprehensive Reviewcited by 17
- 2024DiffSensei: Bridging Multi-Modal LLMs and Diffusion Models for Customized Manga Generationcited by 16
- 2023Manga109Dialog: A Large-scale Dialogue Dataset for Comics Speaker Detectioncited by 13
- 2022COO: Comic Onomatopoeia Dataset for Recognizing Arbitrary or Truncated Textscited by 12
- 2024Tails Tell Tales: Chapter-Wide Manga Transcriptions with Character Namescited by 10
- 2021USB: Universal-Scale Object Detection Benchmarkcited by 9
- 2023Identity-Aware Semi-Supervised Learning for Comic Character Re-Identificationcited by 8
- 2024MangaUB: A Manga Understanding Benchmark for Large Multimodal Modelscited by 7
- 2021Sharing to learn and learning to share; Fitting together Meta-Learning, Multi-Task Learning, and Transfer Learning: A meta reviewcited by 6
- 2022A Challenging Benchmark of Anime Style Recognitioncited by 6
25 more
- 2025MangaVQA and MangaLMM: A Benchmark and Specialized Model for Multimodal Manga Understandingcited by 6
- 2025From Panels to Prose: Generating Literary Narratives from Comicscited by 5
- 2022A Comprehensive Gold Standard and Benchmark for Comics Text Detection and Recognitioncited by 4
- 2025Evaluating Multimodal Large Language Models on Vertically Written Japanese Textcited by 4
- 2021Painting Style-Aware Manga Colorization Based on Generative Adversarial Networkscited by 3
- 2024AnySR: Realizing Image Super-Resolution as Any-Scale, Any-Resourcecited by 3
- 2025Re:Verse -- Can Your VLM Read a Manga?cited by 3
- 2023MaRU: A Manga Retrieval and Understanding System Connecting Vision and Languagecited by 2
- 2024Differentiable Search for Finding Optimal Quantization Strategycited by 2
- 2024M2M-Gen: A Multimodal Framework for Automated Background Music Generation in Japanese Manga Using Large Language Modelscited by 2
- 2026Gaze Heads: How VLMs Look at What They Describecited by 2
- 2021Visual representation of negation: Real world data analysis on comic image designcited by 1
- 2024Unlocking Comics: The AI4VA Dataset for Visual Understandingcited by 1
- 2024Context-Informed Machine Translation of Manga using Multimodal Large Language Modelscited by 1
- 2025Co-Speech Gesture and Facial Expression Generation for Non-Photorealistic 3D Characterscited by 1
- 2026Manga109-v2026: Revisiting Manga109 Annotations for Modern Manga Understandingcited by 1
- 2026MangaFlow: An End-to-End Agentic Framework for Controllable Story to Manga Generationcited by 1
- 2022Detection of Furigana Text in Imagescited by 0
- 2023A High-Frequency Focused Network for Lightweight Single Image Super-Resolutioncited by 0
- 2023EPNet: An Efficient Pyramid Network for Enhanced Single-Image Super-Resolution with Reduced Computational Requirementscited by 0
- 2025Emotion-Aware Speech Generation with Character-Specific Voices for Comicscited by 0
- 2025A Large-scale Dataset for Robust Complex Anime Scene Text Detectioncited by 0
- 2026Question-Guided Evidence Acquisition for Multimodal Visual Question Answeringcited by 0
- 2026ManGo: Manga Active Narrative Grounding Optimizationcited by 0
- 2026Re:Cognize -- Open-Set Comic Character Re-Identificationcited by 0
- 2026Re:Cognize -- Open-Set Comic Character Re-Identification27 Sep 2026
- 2026ManGo: Manga Active Narrative Grounding Optimization30 Aug 2026
- 2026Question-Guided Evidence Acquisition for Multimodal Visual Question Answering20 Aug 2026
- 2026Gaze Heads: How VLMs Look at What They Describe12 Jun 2026
- 2026MangaFlow: An End-to-End Agentic Framework for Controllable Story to Manga Generation27 May 2026
- 2026Manga109-v2026: Revisiting Manga109 Annotations for Modern Manga Understanding20 May 2026
- 2025Evaluating Multimodal Large Language Models on Vertically Written Japanese Text19 Nov 2025
- 2025A Large-scale Dataset for Robust Complex Anime Scene Text Detection9 Oct 2025
- 2025Emotion-Aware Speech Generation with Character-Specific Voices for Comics18 Sep 2025
- 2025Re:Verse -- Can Your VLM Read a Manga?11 Aug 2025
- 2025Co-Speech Gesture and Facial Expression Generation for Non-Photorealistic 3D Characters19 Jun 2025
- 2025MangaVQA and MangaLMM: A Benchmark and Specialized Model for Multimodal Manga Understanding26 May 2025
25 more
- 2025From Panels to Prose: Generating Literary Narratives from Comics30 Mar 2025
- 2024DiffSensei: Bridging Multi-Modal LLMs and Diffusion Models for Customized Manga Generation10 Dec 2024
- 2024Context-Informed Machine Translation of Manga using Multimodal Large Language Models4 Nov 2024
- 2024Unlocking Comics: The AI4VA Dataset for Visual Understanding27 Oct 2024
- 2024M2M-Gen: A Multimodal Framework for Automated Background Music Generation in Japanese Manga Using Large Language Models13 Oct 2024
- 2024Tails Tell Tales: Chapter-Wide Manga Transcriptions with Character Names1 Aug 2024
- 2024MangaUB: A Manga Understanding Benchmark for Large Multimodal Models26 Jul 2024
- 2024AnySR: Realizing Image Super-Resolution as Any-Scale, Any-Resource5 Jul 2024
- 2024Differentiable Search for Finding Optimal Quantization Strategy10 Apr 2024
- 2024The Manga Whisperer: Automatically Generating Transcriptions for Comics18 Jan 2024
- 2023EPNet: An Efficient Pyramid Network for Enhanced Single-Image Super-Resolution with Reduced Computational Requirements20 Dec 2023
- 2023MaRU: A Manga Retrieval and Understanding System Connecting Vision and Language22 Oct 2023
- 2023Identity-Aware Semi-Supervised Learning for Comic Character Re-Identification17 Aug 2023
- 2023Unleashing the Power of Self-Supervised Image Denoising: A Comprehensive Review1 Aug 2023
- 2023Manga109Dialog: A Large-scale Dialogue Dataset for Comics Speaker Detection30 Jun 2023
- 2023A High-Frequency Focused Network for Lightweight Single Image Super-Resolution21 Mar 2023
- 2022A Comprehensive Gold Standard and Benchmark for Comics Text Detection and Recognition27 Dec 2022
- 2022COO: Comic Onomatopoeia Dataset for Recognizing Arbitrary or Truncated Texts11 Jul 2022
- 2022Detection of Furigana Text in Images8 Jul 2022
- 2022A Challenging Benchmark of Anime Style Recognition29 Apr 2022
- 2021Sharing to learn and learning to share; Fitting together Meta-Learning, Multi-Task Learning, and Transfer Learning: A meta review23 Nov 2021
- 2021Transformer for Single Image Super-Resolution25 Aug 2021
- 2021Painting Style-Aware Manga Colorization Based on Generative Adversarial Networks16 Jul 2021
- 2021Visual representation of negation: Real world data analysis on comic image design21 May 2021
- 2021USB: Universal-Scale Object Detection Benchmark25 Mar 2021
- 2024DiffSensei: Bridging Multi-Modal LLMs and Diffusion Models for Customized Manga Generationcited by 16
- 2024MangaUB: A Manga Understanding Benchmark for Large Multimodal Modelscited by 7
- 2025From Panels to Prose: Generating Literary Narratives from Comicscited by 5
- 2025Evaluating Multimodal Large Language Models on Vertically Written Japanese Textcited by 4
- 2025Re:Verse -- Can Your VLM Read a Manga?cited by 3
- 2026Gaze Heads: How VLMs Look at What They Describecited by 2
- 2024Context-Informed Machine Translation of Manga using Multimodal Large Language Modelscited by 1
- 2026Question-Guided Evidence Acquisition for Multimodal Visual Question Answeringcited by 0
- 2026Question-Guided Evidence Acquisition for Multimodal Visual Question Answering20 Aug 2026
- 2026Gaze Heads: How VLMs Look at What They Describe12 Jun 2026
- 2025Evaluating Multimodal Large Language Models on Vertically Written Japanese Text19 Nov 2025
- 2025Re:Verse -- Can Your VLM Read a Manga?11 Aug 2025
- 2025From Panels to Prose: Generating Literary Narratives from Comics30 Mar 2025
- 2024DiffSensei: Bridging Multi-Modal LLMs and Diffusion Models for Customized Manga Generation10 Dec 2024
- 2024Context-Informed Machine Translation of Manga using Multimodal Large Language Models4 Nov 2024
- 2024MangaUB: A Manga Understanding Benchmark for Large Multimodal Models26 Jul 2024
- 2021Transformer for Single Image Super-Resolutioncited by 150
- 2024The Manga Whisperer: Automatically Generating Transcriptions for Comicscited by 20
- 2023Unleashing the Power of Self-Supervised Image Denoising: A Comprehensive Reviewcited by 17
- 2023Manga109Dialog: A Large-scale Dialogue Dataset for Comics Speaker Detectioncited by 13
- 2022COO: Comic Onomatopoeia Dataset for Recognizing Arbitrary or Truncated Textscited by 12
- 2024Tails Tell Tales: Chapter-Wide Manga Transcriptions with Character Namescited by 10
- 2021USB: Universal-Scale Object Detection Benchmarkcited by 9
- 2023Identity-Aware Semi-Supervised Learning for Comic Character Re-Identificationcited by 8
- 2021Sharing to learn and learning to share; Fitting together Meta-Learning, Multi-Task Learning, and Transfer Learning: A meta reviewcited by 6
- 2022A Challenging Benchmark of Anime Style Recognitioncited by 6
- 2025MangaVQA and MangaLMM: A Benchmark and Specialized Model for Multimodal Manga Understandingcited by 6
- 2022A Comprehensive Gold Standard and Benchmark for Comics Text Detection and Recognitioncited by 4
12 most cited of 28 All 28 (JSON)
- 2026Re:Cognize -- Open-Set Comic Character Re-Identification27 Sep 2026
- 2026ManGo: Manga Active Narrative Grounding Optimization30 Aug 2026
- 2026Manga109-v2026: Revisiting Manga109 Annotations for Modern Manga Understanding20 May 2026
- 2025A Large-scale Dataset for Robust Complex Anime Scene Text Detection9 Oct 2025
- 2025Emotion-Aware Speech Generation with Character-Specific Voices for Comics18 Sep 2025
- 2025Co-Speech Gesture and Facial Expression Generation for Non-Photorealistic 3D Characters19 Jun 2025
- 2025MangaVQA and MangaLMM: A Benchmark and Specialized Model for Multimodal Manga Understanding26 May 2025
- 2024Unlocking Comics: The AI4VA Dataset for Visual Understanding27 Oct 2024
- 2024M2M-Gen: A Multimodal Framework for Automated Background Music Generation in Japanese Manga Using Large Language Models13 Oct 2024
- 2024Tails Tell Tales: Chapter-Wide Manga Transcriptions with Character Names1 Aug 2024
- 2024AnySR: Realizing Image Super-Resolution as Any-Scale, Any-Resource5 Jul 2024
- 2024Differentiable Search for Finding Optimal Quantization Strategy10 Apr 2024
12 newest of 28 All 28 (JSON)