Catch Me If You Can: Deceiving Stance Detection and Geotagging Models to Protect Privacy of Individuals on Twitter
Not on the map. Why?
Abstract (arXiv)
The recent advances in natural language processing have yielded many exciting developments in text analysis and language understanding models; however, these models can also be used to track people, bringing severe privacy concerns. In this work, we investigate what individuals can do to avoid being detected by those models while using social media platforms. We ground our investigation in two exposure-risky tasks, stance detection and geotagging. We explore a variety of simple techniques for modifying text, such as inserting typos in salient words, paraphrasing, and adding dummy social media posts. Our experiments show that the performance of BERT-based models fined tuned for stance detection decreases significantly due to typos, but it is not affected by paraphrasing. Moreover, we find that typos have minimal impact on state-of-the-art geotagging models due to their increased reliance on social networks; however, we show that users can deceive those models by interacting with different users, reducing their performance by almost 50%.
Key facts. No citing papers in the map yet (data through 13 Oct 2026). Builds on 23 of its 41 references that are in the map. First posted on arXiv 23 Jul 2022.
Builds on
23 of 41 references.
References · 23
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,304
- 2020Language Models are Few-Shot Learnerscited by 32,320
- 2016Enriching Word Vectors with Subword Informationcited by 1,581
- 2017BadNets: Identifying Vulnerabilities in the Machine Learning Model Supply Chaincited by 1,099
- 2019Is BERT Really Robust? A Strong Baseline for Natural Language Attack on Text Classification and Entailmentcited by 668
- 2017Adversarial Examples for Evaluating Reading Comprehension Systemscited by 571
- 2018TextBugger: Generating Adversarial Text Against Real-world Applicationscited by 381
- 2020Weight Poisoning Attacks on Pre-trained Modelscited by 341
- 2017Synthetic and Natural Noise Both Break Neural Machine Translationcited by 306
- 2019A backdoor attack against LSTM-based text classification systemscited by 227
- 2019Probing Neural Network Comprehension of Natural Language Argumentscited by 213
- 2017Deep Text Classification Can be Fooledcited by 106
11 more
- 2021Be Careful about Poisoned Word Embeddings: Exploring the Vulnerability of the Embedding Layers in NLP Modelscited by 105
- 2020Reevaluating Adversarial Examples in Natural Languagecited by 84
- 2020Adv-BERT: BERT is not robust on misspellings! Generating nature adversarial samples on BERTcited by 69
- 2018Integrating Stance Detection and Fact Checking in a Unified Corpuscited by 41
- 2020Stance Detection Benchmark: How Robust Is Your Stance Detection?cited by 33
- 2018Semi-supervised User Geolocation via Graph Convolutional Networkscited by 27
- 2018Adversarial Over-Sensitivity and Over-Stability Strategies for Dialogue Modelscited by 25
- 2020Stance Detection in Web and Social Media: A Comparative Studycited by 25
- 2020Natural Backdoor Attack on Text Datacited by 22
- 2020Embeddings-Based Clustering for Target Specific Stances: The Case of a Polarized Turkeycited by 12
- 2020Adapting Deep Learning Methods for Mental Health Prediction on Social Mediacited by 10
Built on by
Not cited yet.