Can LLMs Follow the Pulse of a Crisis? Evaluating Crisis Sentiment in Bangladesh's July Uprising
Not on the map. Why?
Abstract (arXiv)
Crisis sentiment analysis is especially challenging for low-resource languages such as Bangla, where language, context, and public reaction shift rapidly. We introduce UNRESTSENT200K, a Bangla crisis sentiment dataset with approximately 200K Facebook and YouTube comments from the July-August 2024 Bangladesh uprising. The dataset covers five event-aligned phases, from early escalation and internet blackout to regime transition and a later flood crisis. Each comment is linked to its parent post, enabling evaluation with and without discourse context. All comments are annotated through a fully human process involving 14 native Bangla-speaking annotators and senior validation, achieving substantial agreement (kappa = 0.73, alpha = 0.71) and 94.2% blind-audit agreement. We benchmark fine-tuned encoders, prompted LLMs, and LoRA-tuned LLMs. Results show that parent-post context consistently improves performance, while temporal shift across phases causes large performance drops. Strong LLMs perform well, but still struggle with sarcasm, implicit political references, and phase-dependent meaning. UNRESTSENT200K provides a benchmark for studying context-aware and temporally robust sentiment analysis in low-resource crisis discourse. UNRESTSENT200K is available at https://sami0055.github.io/UNRESTSENT200K/
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 14 of its 34 references that are in the map. First posted on arXiv 15 Sep 2026.
Builds on
14 of 34 references.
References · 14
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,935
- 2022BERTopic: Neural topic modeling with a class-based TF-IDF procedurecited by 801
- 2015Image-based Recommendations on Styles and Substitutescited by 706
- 2021BanglaBERT: Language Model Pretraining and Benchmarks for Low-Resource Language Understanding Evaluation in Banglacited by 125
- 2022Hate Speech and Offensive Language Detection in Bengalicited by 19
- 2022BD-SHS: A Benchmark Dataset for Learning to Detect Online Bangla Hate Speech in Different Social Contextscited by 14
- 2023Offensive Language Identification in Transliterated and Code-Mixed Banglacited by 12
- 2024BnSentMix: A Diverse Bengali-English Code-Mixed Dataset for Sentiment Analysiscited by 10
- 2024BanTH: A Multi-label Hate Speech Detection Dataset for Transliterated Banglacited by 10
- 2025LLM-Based Multi-Task Bangla Hate Speech Detection: Type, Severity, and Targetcited by 6
- 2025ANUBHUTI: A Comprehensive Corpus For Sentiment Analysis In Bangla Regional Languagescited by 3
Built on by
Not cited yet.