mlsanityData to 13 Oct 2026

M2C: Towards Automatic Multimodal Manga Complement

arXiv 2310.17130 ↗First posted 26 Oct 2023cs.CLcited by 7

Not on the map. Why?

Abstract (arXiv)

Multimodal manga analysis focuses on enhancing manga understanding with visual and textual features, which has attracted considerable attention from both natural language processing and computer vision communities. Currently, most comics are hand-drawn and prone to problems such as missing pages, text contamination, and aging, resulting in missing comic text content and seriously hindering human comprehension. In other words, the Multimodal Manga Complement (M2C) task has not been investigated, which aims to handle the aforementioned issues by providing a shared semantic space for vision and language understanding. To this end, we first propose the Multimodal Manga Complement task by establishing a new M2C benchmark dataset covering two languages. First, we design a manga argumentation method called MCoT to mine event knowledge in comics with large language models. Then, an effective baseline FVP-M2 using fine-grained visual prompts is proposed to support manga complement. Extensive experimental results show the effectiveness of FVP-M2 method for Multimodal Mange Complement.

Key facts. Cited by 7 papers in the map (data through 13 Oct 2026). Builds on 25 of its 37 references that are in the map. First posted on arXiv 26 Oct 2023.

Builds on

25 of 37 references.

References · 25

  1. 2017Attention Is All You Needcited by 60,106
  2. 2014Adam: A Method for Stochastic Optimizationcited by 37,093
  3. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,588
  4. 2022Training language models to follow instructions with human feedbackcited by 15,856
  5. 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,657
  6. 2019ViLBERT: Pretraining Task-Agnostic Visiolinguistic Representations for Vision-and-Language Taskscited by 2,220
  7. 2019fairseq: A Fast, Extensible Toolkit for Sequence Modelingcited by 1,487
  8. 2019HowTo100M: Learning a Text-Video Embedding by Watching Hundred Million Narrated Video Clipscited by 946
  9. 2014Show and Tell: A Neural Image Caption Generatorcited by 878
  10. 2016Google's Multilingual Neural Machine Translation System: Enabling Zero-Shot Translationcited by 467
  11. 2019Unicoder-VL: A Universal Encoder for Vision and Language by Cross-modal Pre-trainingcited by 451
  12. 2021Do Transformers Really Perform Bad for Graph Representation?cited by 319
13 more
  1. 2023OWL: A Large Language Model for IT Operationscited by 43
  2. 2020Dynamic Context-guided Capsule Network for Multimodal Machine Translationcited by 36
  3. 2021Multilingual Machine Translation Systems from Microsoft for WMT21 Shared Taskcited by 34
  4. 2022On Vision Features in Multimodal Machine Translationcited by 31
  5. 2019Distilling Translations with Visual Awarenesscited by 30
  6. 2020XLM-T: Scaling up Multilingual Machine Translation with Pretrained Cross-lingual Transformer Encoderscited by 24
  7. 2020Towards Fully Automated Manga Translationcited by 21
  8. 2021Vision Matters When It Should: Sanity Checking Multimodal Machine Translation Modelscited by 21
  9. 2022LVP-M3: Language-aware Visual Prompt for Multilingual Multimodal Machine Translationcited by 21
  10. 20223D-QueryIS: A Query-based Framework for 3D Instance Segmentationcited by 14
  11. 2023GripRank: Bridging the Gap between Retrieval and Generation via the Generative Knowledge Improved Passage Rankingcited by 11
  12. 2022LogLG: Weakly Supervised Log Anomaly Detection via Log-Event Graph Constructioncited by 8
  13. 2023Multilingual Entity and Relation Extraction from Unified to Language-specific Trainingcited by 3

Built on by

Cited by year

Citing papers per year: 2024: 6; 2025: 1.

7 papers.

  1. 2024IW-Bench: Evaluating Large Multimodal Models for Converting Image-to-Webcited by 16
  2. 2024One missing piece in Vision and Language: A Survey on Comics Understandingcited by 8
  3. 2024m3P: Towards Multimodal Multilingual Translation with Multimodal Promptcited by 6
  4. 2024SVIPTR: Fast and Efficient Scene Text Recognition with Vision Permutable Extractorcited by 5
  5. 2025Re:Verse -- Can Your VLM Read a Manga?cited by 3
  6. 2024Toward accessible comics for blind and low vision readerscited by 2
  7. 2024Context-Informed Machine Translation of Manga using Multimodal Large Language Modelscited by 1