mlsanityData to 14 Oct 2026

Social media polarization during conflict: Insights from an ideological stance dataset on Israel-Palestine Reddit comments

arXiv 2502.00414 ↗First posted 1 Feb 2025cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

In politically sensitive scenarios like wars, social media serves as a platform for polarized discourse and expressions of strong ideological stances. While prior studies have explored ideological stance detection in general contexts, limited attention has been given to conflict-specific settings. This study addresses this gap by analyzing 9,969 Reddit comments related to the Israel-Palestine conflict, collected between October 2023 and August 2024. The comments were categorized into three stance classes: Pro-Israel, Pro-Palestine, and Neutral. Various approaches, including machine learning, pre-trained language models, neural networks, and prompt engineering strategies for open source large language models (LLMs), were employed to classify these stances. Performance was assessed using metrics such as accuracy, precision, recall, and F1-score. Among the tested methods, the Scoring and Reflective Re-read prompt in Mixtral 8x7B demonstrated the highest performance across all metrics. This study provides comparative insights into the effectiveness of different models for detecting ideological stances in highly polarized social media contexts. The dataset used in this research is publicly available for further exploration and validation.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 19 of its 42 references that are in the map. First posted on arXiv 1 Feb 2025.

Builds on

19 of 42 references.

References · 19

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2020Language Models are Few-Shot Learnerscited by 32,419
  3. 2019DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lightercited by 4,307
  4. 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,935
  5. 2023Qwen Technical Reportcited by 3,344
  6. 2023The Falcon Series of Open Language Modelscited by 535
  7. 2018Fundamentals of Recurrent Neural Network (RNN) and Long Short-Term Memory (LSTM) Networkcited by 420
  8. 2023From Pretraining Data to Language Models to Downstream Tasks: Tracking the Trails of Political Biases Leading to Unfair NLP Modelscited by 260
  9. 2017Gate-Variants of Gated Recurrent Unit (GRU) Neural Networkscited by 242
  10. 2018Deep Bidirectional and Unidirectional LSTM Recurrent Neural Network for Network-wide Traffic Speed Predictioncited by 61
  11. 2018Topic-Specific Sentiment Analysis Can Help Identify Political Ideologycited by 10
  12. 2024Whose Side Are You On? Investigating the Political Stance of Large Language Modelscited by 10
7 more
  1. 2024LLMs left, right, and center: Assessing GPT's capabilities to label political bias from web domainscited by 9
  2. 2025Religious Bias Landscape in Language and Text-to-Image Models: Analysis, Detection, and Debiasing Strategiescited by 9
  3. 2024Deciphering Political Entity Sentiment in News with Large Language Models: Zero-Shot and Few-Shot Strategiescited by 8
  4. 2024IsamasRed: A Public Dataset Tracking Reddit Discussions on Israel-Hamas Conflictcited by 6
  5. 2022Negativity Spreads Faster: A Large-Scale Multilingual Twitter Analysis on the Role of Sentiment in Political Communicationcited by 3
  6. 2022Taking sides: Public Opinion over the Israel-Palestine Conflict in 2021cited by 2
  7. 2024New Directions in Text Classification Research: Maximizing The Performance of Sentiment Classification from Limited Datacited by 1

Built on by

Not cited yet.