mlsanityData to 7 Oct 2026

NLP Privacy Risk Identification in Social Media (NLP-PRISM): A Survey

arXiv 2602.15866 ↗First posted 26 Jan 2026cs.CL cs.AI cs.CRcited by 0

Not on the map. Why?

Abstract (arXiv)

Natural Language Processing (NLP) is integral to social media analytics but often processes content containing Personally Identifiable Information (PII), behavioral cues, and metadata raising privacy risks such as surveillance, profiling, and targeted advertising. To systematically assess these risks, we review 203 peer-reviewed papers and propose the NLP Privacy Risk Identification in Social Media (NLP-PRISM) framework, which evaluates vulnerabilities across six dimensions: data collection, preprocessing, visibility, fairness, computational risk, and regulatory compliance. Our analysis shows that transformer models achieve F1-scores ranging from 0.58-0.84, but incur a 1% - 23% drop under privacy-preserving fine-tuning. Using NLP-PRISM, we examine privacy coverage in six NLP tasks: sentiment analysis (16), emotion detection (14), offensive language identification (19), code-mixed processing (39), native language identification (29), and dialect detection (24) revealing substantial gaps in privacy research. We further found a (reduced by 2% - 9%) trade-off in model utility, MIA AUC (membership inference attacks) 0.81, AIA accuracy 0.75 (attribute inference attacks). Finally, we advocate for stronger anonymization, privacy-aware learning, and fairness-driven training to enable ethical NLP in social media contexts.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 61 of its 210 references that are in the map. First posted on arXiv 26 Jan 2026.

Builds on

61 of 210 references.

References · 61

  1. 2015Character-level Convolutional Networks for Text Classificationcited by 2,293
  2. 2016Membership Inference Attacks against Machine Learning Modelscited by 2,221
  3. 2017Automated Hate Speech Detection and the Problem of Offensive Languagecited by 724
  4. 2018MELD: A Multimodal Multi-Party Dataset for Emotion Recognition in Conversationscited by 636
  5. 2023Analyzing Leakage of Personally Identifiable Information in Language Modelscited by 278
  6. 2019Predicting the Type and Target of Offensive Posts in Social Mediacited by 268
  7. 2023Membership Inference Attacks against Language Models via Neighbourhood Comparisoncited by 249
  8. 2019SemEval-2019 Task 6: Identifying and Categorizing Offensive Language in Social Media (OffensEval)cited by 206
  9. 2016Demographic Dialectal Variation in Social Media: A Case Study of African-American Englishcited by 194
  10. 2020SemEval-2020 Task 12: Multilingual Offensive Language Identification in Social Media (OffensEval 2020)cited by 138
  11. 2022COLD: A Benchmark for Chinese Offensive Language Detectioncited by 74
  12. 2021Agreeing to Disagree: Annotating Offensive Language Datasets with Annotators' Disagreementcited by 71
38 more
  1. 2023Multilingual Large Language Models Are Not (Yet) Code-Switcherscited by 65
  2. 2020SemEval-2020 Task 9: Overview of Sentiment Analysis of Code-Mixed Tweetscited by 62
  3. 2021The Impact of Multiple Parallel Phrase Suggestions on Email Input and Composition Behaviour of Native and Non-Native English Writerscited by 61
  4. 2023A Survey of Code-switching: Linguistic and Social Perspectives for Language Technologiescited by 59
  5. 2024Linguistic Bias in ChatGPT: Language Models Reinforce Dialect Discriminationcited by 55
  6. 2020SOLID: A Large-Scale Semi-Supervised Dataset for Offensive Language Identificationcited by 53
  7. 2020A Sentiment Analysis Dataset for Code-Mixed Malayalam-Englishcited by 50
  8. 2023Prompting Multilingual Large Language Models to Generate Code-Mixed Texts: The Case of South East Asian Languagescited by 50
  9. 2020Offensive Language Identification in Greekcited by 49
  10. 2024DIALECTBENCH: A NLP Benchmark for Dialects, Varieties, and Closely-Related Languagescited by 49
  11. 2019Offensive Language and Hate Speech Detection for Danishcited by 48
  12. 2020NADI 2020: The First Nuanced Arabic Dialect Identification Shared Taskcited by 47
  13. 2023SemEval-2023 Task 12: Sentiment Analysis for African Languages (AfriSenti-SemEval)cited by 41
  14. 2018Automatic Language Identification in Texts: A Surveycited by 40
  15. 2017WASSA-2017 Shared Task on Emotion Intensitycited by 37
  16. 2023You Only Prompt Once: On the Capabilities of Prompt Learning on Large Language Models to Tackle Toxic Contentcited by 37
  17. 2021NADI 2021: The Second Nuanced Arabic Dialect Identification Shared Taskcited by 32
  18. 2024ToxiCloakCN: Evaluating Robustness of Offensive Language Detection in Chinese with Cloaking Perturbationscited by 30
  19. 2023NADI 2023: The Fourth Nuanced Arabic Dialect Identification Shared Taskcited by 29
  20. 2022NADI 2022: The Third Nuanced Arabic Dialect Identification Shared Taskcited by 23
  21. 2024NADI 2024: The Fifth Nuanced Arabic Dialect Identification Shared Taskcited by 23
  22. 2018Privacy in Social Media: Identification, Mitigation and Applicationscited by 18
  23. 2018Code-switched Language Models Using Dual RNNs and Same-Source Pretrainingcited by 16
  24. 2018Native Language Cognate Effects on Second Language Lexical Choicecited by 11
  25. 2023Language and Mental Health: Measures of Emotion Dynamics from Text as Linguistic Biosocial Markerscited by 11
  26. 2024SemEval-2024 Task 3: Multimodal Emotion Cause Analysis in Conversationscited by 11
  27. 2017Predicting Native Language from Gazecited by 9
  28. 2025Safeguarding Privacy of Retrieval Data against Membership Inference Attacks: Is This Query Too Close to Home?cited by 8
  29. 2023SentMix-3L: A Bangla-English-Hindi Code-Mixed Dataset for Sentiment Analysiscited by 7
  30. 2022Overview of the HASOC Subtrack at FIRE 2022: Offensive Language Identification in Marathicited by 5
  31. 2023OffMix-3L: A Novel Code-Mixed Dataset in Bangla-English-Hindi for Offensive Language Identificationcited by 5
  32. 2024SemEval 2024 -- Task 10: Emotion Discovery and Reasoning its Flip in Conversation (EDiReF)cited by 5
  33. 2024A Federated Learning Approach to Privacy Preserving Offensive Language Identificationcited by 4
  34. 2025Natural Language Processing of Privacy Policies: A Surveycited by 3
  35. 2025Stealing Training Data from Large Language Models in Decentralized Training through Activation Inversion Attackcited by 3
  36. 2018Automatically Generating a Large, Culture-Specific Blocklist for Chinacited by 2
  37. 2022Findings of the Shared Task on Offensive Span Identification from Code-Mixed Tamil-English Commentscited by 2
  38. 2024Pruning Multilingual Large Language Models for Multilingual Inferencecited by 2

50 most cited of 61 All 61 (JSON)

Built on by

Not cited yet.