mlsanityData to 7 Oct 2026

Unlocking Comics: The AI4VA Dataset for Visual Understanding

arXiv 2410.20459 ↗First posted 27 Oct 2024cs.CV cs.ETcited by 1

Not on the map. Why?

Abstract (arXiv)

In the evolving landscape of deep learning, there is a pressing need for more comprehensive datasets capable of training models across multiple modalities. Concurrently, in digital humanities, there is a growing demand to leverage technology for diverse media adaptation and creation, yet limited by sparse datasets due to copyright and stylistic constraints. Addressing this gap, our paper presents a novel dataset comprising Franco-Belgian comics from the 1950s annotated for tasks including depth estimation, semantic segmentation, saliency detection, and character identification. It consists of two distinct and consistent styles and incorporates object concepts and labels taken from natural images. By including such diverse information across styles, this dataset not only holds promise for computational creativity but also offers avenues for the digitization of art and storytelling innovation. This dataset is a crucial component of the AI4VA Workshop Challenges~urlhttps://sites.google.com/view/ai4vaeccv2024, where we specifically explore depth and saliency. Dataset details at urlhttps://github.com/IVRL/AI4VA.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 32 of its 61 references that are in the map. First posted on arXiv 27 Oct 2024.

Builds on

32 of 61 references.

References · 32

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2020Language Models are Few-Shot Learnerscited by 32,199
  3. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  4. 2014Microsoft COCO: Common Objects in Contextcited by 17,498
  5. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
  6. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
  7. 2016Densely Connected Convolutional Networkscited by 6,691
  8. 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,690
  9. 2022Flamingo: a Visual Language Model for Few-Shot Learningcited by 4,337
  10. 2014Going Deeper with Convolutionscited by 4,231
  11. 2016Aggregated Residual Transformations for Deep Neural Networkscited by 2,540
  12. 2015Learning Deep Features for Discriminative Localizationcited by 2,430
20 more
  1. 2021Masked-attention Mask Transformer for Universal Image Segmentationcited by 2,338
  2. 2021Vision Transformers for Dense Predictioncited by 1,789
  3. 2019Towards Robust Monocular Depth Estimation: Mixing Datasets for Zero-shot Cross-dataset Transfercited by 1,484
  4. 2024Depth Anything: Unleashing the Power of Large-Scale Unlabeled Datacited by 1,346
  5. 2021EfficientNetV2: Smaller Models and Faster Trainingcited by 1,127
  6. 2023ZoeDepth: Zero-shot Transfer by Combining Relative and Metric Depthcited by 646
  7. 2018Cross-Domain Weakly-Supervised Object Detection through Progressive Domain Adaptationcited by 218
  8. 2016What do different evaluation metrics tell us about saliency models?cited by 184
  9. 2023DDP: Diffusion Model for Dense Visual Predictioncited by 148
  10. 2019Smooth Grad-CAM++: An Enhanced Inference Level Visualization Technique for Deep Convolutional Neural Network Modelscited by 118
  11. 2020Unified Image and Video Saliency Modelingcited by 74
  12. 2014Deep Gaze I: Boosting Saliency Prediction with Feature Maps Trained on ImageNetcited by 58
  13. 2021DeepGaze IIE: Calibrated prediction in and out-of-domain for state-of-the-art saliency modelingcited by 55
  14. 2016The Amazing Mysteries of the Gutter: Drawing Inferences Between Panels in Comic Book Narrativescited by 41
  15. 2020Building a Manga Dataset "Manga109" with Annotations for Multimedia Applicationscited by 37
  16. 2020Predicting Visual Importance Across Graphic Design Typescited by 30
  17. 2023TempSAL -- Uncovering Temporal Information for Deep Saliency Predictioncited by 25
  18. 2020Tidying Deep Saliency Prediction Architecturescited by 20
  19. 2023EVP: Enhanced Visual Perception using Inverse Multi-Attentive Feature Refinement and Regularized Image-Text Alignmentcited by 14
  20. 2021Estimating Image Depth in the Comics Domaincited by 8

Built on by

Cited by year

Citing papers per year: 2025: 1.

1 paper.

  1. 2025Zooming into Comics: Region-Aware RL Improves Fine-Grained Comic Understanding in Vision-Language Modelscited by 1