mlsanityData to 7 Oct 2026

ArtELingo: A Million Emotion Annotations of WikiArt with Emphasis on Diversity over Language and Culture

arXiv 2211.10780 ↗First posted 19 Nov 2022cs.CL cs.AI cs.CYcited by 17

Not on the map. Why?

Abstract (arXiv)

This paper introduces ArtELingo, a new benchmark and dataset, designed to encourage work on diversity across languages and cultures. Following ArtEmis, a collection of 80k artworks from WikiArt with 0.45M emotion labels and English-only captions, ArtELingo adds another 0.79M annotations in Arabic and Chinese, plus 4.8K in Spanish to evaluate "cultural-transfer" performance. More than 51K artworks have 5 annotations or more in 3 languages. This diversity makes it possible to study similarities and differences across languages and cultures. Further, we investigate captioning tasks, and find diversity improves the performance of baseline models. ArtELingo is publicly available at https://www.artelingo.org/ with standard splits and baseline models. We hope our work will help ease future research on multilinguality and culturally-aware AI.

Key facts. Cited by 17 papers in the map (data through 7 Oct 2026). Builds on 25 of its 57 references that are in the map. First posted on arXiv 19 Nov 2022.

Builds on

25 of 57 references.

References · 25

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2014Microsoft COCO: Common Objects in Contextcited by 17,498
  4. 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,617
  5. 2022Flamingo: a Visual Language Model for Few-Shot Learningcited by 4,337
  6. 2021On the Opportunities and Risks of Foundation Modelscited by 3,961
  7. 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,907
  8. 2019HuggingFace's Transformers: State-of-the-art Natural Language Processingcited by 2,201
  9. 2019A Survey on Bias and Fairness in Machine Learningcited by 1,911
  10. 2015Show, Attend and Tell: Neural Image Caption Generation with Visual Attentioncited by 1,421
  11. 2016Man is to Computer Programmer as Woman is to Homemaker? Debiasing Word Embeddingscited by 1,304
  12. 2020GoEmotions: A Dataset of Fine-Grained Emotionscited by 479
13 more
  1. 2021Persistent Anti-Muslim Bias in Large Language Modelscited by 376
  2. 2019Meshed-Memory Transformer for Image Captioningcited by 343
  3. 2021WIT: Wikipedia-based Image Text Dataset for Multimodal Multilingual Machine Learningcited by 285
  4. 2021VisualGPT: Data-efficient Adaptation of Pretrained Language Models for Image Captioningcited by 190
  5. 2021Visually Grounded Reasoning across Languages and Culturescited by 188
  6. 2021ArtEmis: Affective Language for Visual Artcited by 103
  7. 2022IGLUE: A Benchmark for Transfer Learning across Modalities, Tasks, and Languagescited by 54
  8. 2022It is Okay to Not Be Okay: Overcoming Emotional Bias in Affective Image Captioning by Contrastive Data Collectioncited by 36
  9. 2021Affect2MM: Affective Analysis of Multimedia Content Using Emotion Causalitycited by 17
  10. 2019DENS: A Dataset for Multi-class Emotion Analysiscited by 16
  11. 2020MLM: A Benchmark Dataset for Multitask Learning with Multiple Languages and Modalitiescited by 10
  12. 2021What's in your Head? Emergent Behaviour in Multi-Task Transformer Modelscited by 9
  13. 2021Gender Bias Hidden Behind Chinese Word Embeddings: The Case of Chinese Adjectivescited by 7

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 7; 2024: 4; 2025: 2; 2026: 4.

17 papers.

Sort:

By area:

  1. 2023HRS-Bench: Holistic, Reliable and Scalable Benchmark for Text-to-Image Modelscited by 94
  2. 2023NLPositionality: Characterizing Design Biases of Datasets and Modelscited by 91
  3. 2024Culturally Aware and Adapted NLP: A Taxonomy and a Survey of the State of the Artcited by 26
  4. 2024See It from My Perspective: How Language Affects Cultural Bias in Image Understandingcited by 17
  5. 2023Fairness in Language Models Beyond English: Gaps and Challengescited by 16
  6. 2025CULEMO: Cultural Lenses on Emotion -- Benchmarking LLMs for Cross-Cultural Emotion Understandingcited by 14
  7. 2023OxfordTVG-HIC: Can Machine Make Humorous Captions from Images?cited by 9
  8. 2023Semantic and Expressive Variation in Image Captions Across Languagescited by 8
  9. 2023Socratis: Are large multimodal models emotionally aware?cited by 5
  10. 2023Affective Visual Dialog: A Large-Scale Benchmark for Emotional Reasoning Based on Visually Grounded Conversationscited by 4
  11. 2025A survey of diversity quantification in natural language processing: The why, what, where and howcited by 4
  12. 2024An Efficient Watermarking Method for Latent Diffusion Models via Low-Rank Adaptation and Dynamic Loss Weightingcited by 1
5 more
  1. 2026The Algorithmic Gaze of Image Quality Assessment: An Audit and Trace Ethnography of the LAION-Aesthetics Predictorcited by 1
  2. 2024Solution for Emotion Prediction Competition of Workshop on Emotionally and Culturally Intelligent AIcited by 0
  3. 2026Pragmatics Meets Culture: Culturally-adapted Artwork Description Generation and Evaluationcited by 0
  4. 2026Dimensional Distribution Emotion State: Leveraging Valence and Arousal as a Common Embedding Space for Visual Emotion Analysiscited by 0
  5. 2026MUSE: Benchmarking Large Vision-Language Models on Multi-Modal Understanding in Situated Educationcited by 0