mlsanityData to 7 Oct 2026

MultiClimate: Multimodal Stance Detection on Climate Change Videos

arXiv 2409.18346 ↗First posted 26 Sep 2024cs.CL cs.CVcited by 7

Not on the map. Why?

Abstract (arXiv)

Climate change (CC) has attracted increasing attention in NLP in recent years. However, detecting the stance on CC in multimodal data is understudied and remains challenging due to a lack of reliable datasets. To improve the understanding of public opinions and communication strategies, this paper presents MultiClimate, the first open-source manually-annotated stance detection dataset with 100 CC-related YouTube videos and 4,209 frame-transcript pairs. We deploy state-of-the-art vision and language models, as well as multimodal models for MultiClimate stance detection. Results show that text-only BERT significantly outperforms image-only ResNet50 and ViT. Combining both modalities achieves state-of-the-art, 0.747/0.749 in accuracy/F1. Our 100M-sized fusion models also beat CLIP and BLIP, as well as the much larger 9B-sized multimodal IDEFICS and text-only Llama3 and Gemma2, indicating that multimodal stance detection remains challenging for large language models. Our code, dataset, as well as supplementary materials, are available at https://github.com/werywjw/MultiClimate.

Key facts. Cited by 7 papers in the map (data through 7 Oct 2026). Builds on 11 of its 31 references that are in the map. First posted on arXiv 26 Sep 2024.

Builds on

11 of 31 references.

References · 11

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  4. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  5. 2024The Llama 3 Herd of Modelscited by 14,192
  6. 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,310
  7. 2016Enriching Word Vectors with Subword Informationcited by 1,578
  8. 2021A Survey on Stance Detection for Mis- and Disinformation Identificationcited by 75
  9. 2020Will-They-Won't-They: A Very Large Dataset for Stance Detection on Twittercited by 53
  10. 2023Stance Detection with Collaborative Role-Infused LLM-Based Agentscited by 53
  11. 2024Multi-modal Stance Detection: New Datasets and Modelcited by 18

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 4; 2026: 3.

7 papers.

  1. 2025Exploring Vision Language Models for Multimodal and Multilingual Stance Detectioncited by 3
  2. 2025CliME: Evaluating Multimodal Climate Discourse on Social Media and the Climate Alignment Quotient (CAQ)cited by 2
  3. 2025Two Stage Context Learning with Large Language Models for Multimodal Stance Detection on Climate Changecited by 0
  4. 2025A Multimodal Benchmark for Framing of Oil & Gas Advertising and Potential Greenwashing Detectioncited by 0
  5. 2026TikStance: A Multimodal and Hierarchical Dataset for Multi-target Stance Analysis in TikTok Political Conversationscited by 0
  6. 2026StanceFlip: A Comprehensive Multi-Dimensional Benchmark for Multimodal Conversational Stance Flipping Forecastingcited by 0
  7. 2026MMDS-Bench: Benchmarking Multimodal Large Language Models on Dynamic Stance in Social Media Interactionscited by 0