Community Needs and Assets: A Computational Analysis of Community Conversations
Not on the map. Why?
Abstract (arXiv)
A community needs assessment is a tool used by non-profits and government agencies to quantify the strengths and issues of a community, allowing them to allocate their resources better. Such approaches are transitioning towards leveraging social media conversations to analyze the needs of communities and the assets already present within them. However, manual analysis of exponentially increasing social media conversations is challenging. There is a gap in the present literature in computationally analyzing how community members discuss the strengths and needs of the community. To address this gap, we introduce the task of identifying, extracting, and categorizing community needs and assets from conversational data using sophisticated natural language processing methods. To facilitate this task, we introduce the first dataset about community needs and assets consisting of 3,511 conversations from Reddit, annotated using crowdsourced workers. Using this dataset, we evaluate an utterance-level classification model compared to sentiment classification and a popular large language model (in a zero-shot setting), where we find that our model outperforms both baselines at an F1 score of 94% compared to 49% and 61% respectively. Furthermore, we observe through our study that conversations about needs have negative sentiments and emotions, while conversations about assets focus on location and entities. The dataset is available at https://github.com/towhidabsar/CommunityNeeds.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 27 of its 74 references that are in the map. First posted on arXiv 20 Mar 2024.
Builds on
27 of 74 references.
References · 27
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2017A Unified Approach to Interpreting Model Predictionscited by 6,555
- 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,326
- 2023ChatGPT Outperforms Crowd-Workers for Text-Annotation Taskscited by 870
- 2023Is ChatGPT a Good NLG Evaluator? A Preliminary Studycited by 422
- 2020TweetEval: Unified Benchmark and Comparative Evaluation for Tweet Classificationcited by 417
- 2023Can Large Language Models Transform Computational Social Science?cited by 250
- 2021Latent Hatred: A Benchmark for Understanding Implicit Hate Speechcited by 217
- 2023Is ChatGPT better than Human Annotators? Potential and Limitations of ChatGPT in Explaining Implicit Hate Speechcited by 166
- 2022TimeLMs: Diachronic Language Models from Twittercited by 131
- 2019The role of artificial intelligence in achieving the Sustainable Development Goalscited by 100
15 more
- 2020Fighting the COVID-19 Infodemic: Modeling the Perspective of Journalists, Fact-Checkers, Social Media Platforms, Policy Makers, and the Societycited by 72
- 2021Agreeing to Disagree: Annotating Offensive Language Datasets with Annotators' Disagreementcited by 72
- 2019Analyzing Polarization in Social Media: Method and Application to Tweets on 21 Mass Shootingscited by 67
- 2021Pre-train or Annotate? Domain Adaptation with a Constrained Budgetcited by 27
- 2021Corpus-Level Evaluation for Event QA: The IndiaPoliceEvents Corpus Covering the 2002 Gujarat Violencecited by 19
- 2014How to Ask for a Favor: A Case Study on the Success of Altruistic Requestscited by 15
- 2022Retweet-BERT: Political Leaning Detection Using Language Features and Information Diffusion on Social Networkscited by 13
- 2021Fringe News Networks: Dynamics of US News Viewership following the 2020 Presidential Electioncited by 8
- 2022A Computational Approach to Understand Mental Health from Reddit: Knowledge-aware Multitask Learning Frameworkcited by 8
- 2023Author as Character and Narrator: Deconstructing Personal Narratives from the r/AmITheAsshole Reddit Communitycited by 6
- 2021Social Media Reveals Urban-Rural Differences in Stress across Chinacited by 5
- 2024Infrastructure Ombudsman: Mining Future Failure Concerns from Structural Disaster Responsecited by 4
- 2023Lady and the Tramp Nextdoor: Online Manifestations of Economic Inequalities in the Nextdoor Social Networkcited by 3
- 2022The Geography of Facebook Groups in the United Statescited by 1
- 2023Comfort Foods and Community Connectedness: Investigating Diet Change during COVID-19 Using YouTube Videos on Twittercited by 1
Built on by
Not cited yet.