Splits! Flexible Sociocultural Linguistic Investigation at Scale
Not on the map. Why?
Abstract (arXiv)
Variation in language use, shaped by speakers' sociocultural background and specific context of use, offers a rich lens into cultural perspectives, values, and opinions. For example, Chinese students discuss "healthy eating" with words like "timing," "regularity," and "digestion," whereas Americans use vocabulary like "balancing food groups" and "avoiding fat and sugar," reflecting distinct cultural models of nutrition. The computational study of these Sociocultural Linguistic Phenomena (SLP) has traditionally been done in NLP via tailored analyses of specific groups or topics, requiring specialized data collection and experimental operationalization--a process not well-suited to quick hypothesis exploration and prototyping. To address this, we propose constructing a "sandbox" designed for systematic and flexible sociolinguistic research. Using our method, we construct a demographically/topically split Reddit dataset, Splits!, validated by self-identification and by replicating several known SLPs from existing literature. We showcase the sandbox's utility with a scalable, two-stage process that filters large collections of "potential" SLPs (PSLPs) to surface the most promising candidates for deeper, qualitative investigation.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 23 of its 86 references that are in the map. First posted on arXiv 6 Apr 2025.
Builds on
23 of 86 references.
References · 23
- 2017A Unified Approach to Interpreting Model Predictionscited by 6,488
- 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,040
- 2020ColBERT: Efficient and Effective Passage Search via Contextualized Late Interaction over BERTcited by 1,160
- 2020Language (Technology) is Power: A Critical Survey of "Bias" in NLPcited by 951
- 2020StereoSet: Measuring stereotypical bias in pretrained language modelscited by 911
- 2023Whose Opinions Do Language Models Reflect?cited by 759
- 2019Social Bias Frames: Reasoning about Social and Power Implications of Languagecited by 377
- 2023Large Language Models for Automated Open-domain Scientific Hypotheses Discoverycited by 100
- 2020ConvoKit: A Toolkit for the Analysis of Conversationscited by 71
- 2024Beyond prompt brittleness: Evaluating the reliability and consistency of political worldviews in LLMscited by 55
- 2022VALUE: Understanding Dialect Disparity in NLUcited by 45
- 2020Interpretation of NLP models through input marginalizationcited by 43
11 more
- 2024Natural Language Processing for Dialects of a Language: A Surveycited by 40
- 2024The Perspectivist Paradigm Shift: Assumptions and Challenges of Capturing Human Labelscited by 37
- 2021Does BERT Learn as Humans Perceive? Understanding Linguistic Styles through Lexicacited by 23
- 2023Interactive Concept Learning for Uncovering Latent Themes in Large Text Collectionscited by 15
- 2024Building Knowledge-Guided Lexica to Model Cultural Variationcited by 11
- 2024Investigating Human Values in Online Communitiescited by 10
- 2020Studying Politeness across Cultures Using English Twitter and Mandarin Weibocited by 9
- 2020Using Noisy Self-Reports to Predict Twitter User Demographicscited by 8
- 2023"A Tale of Two Movements": Identifying and Comparing Perspectives in #BlackLivesMatter and #BlueLivesMatter Movements-related Tweets using Weakly Supervised Graph-based Structured Predictioncited by 4
- 2023"We Demand Justice!": Towards Social Context Grounding of Political Textscited by 4
- 2022Subspace Representations for Soft Set Operations and Sentence Similaritiescited by 2
Built on by
Not cited yet.