Privacy Washing: Detecting Internal Contradictions in Privacy Policies
Not on the map. Why?
Abstract (arXiv)
Privacy policies may contain internal contradictions in which commitments are undermined by practices documented elsewhere in the same policy. We operationalize this phenomenon, privacy washing, through a four-stage pipeline: statement extraction, compatibility filtering and natural language inference screening, multi-model judge verification, and thematic analysis, with contradictions confirmed by majority vote of a three-model LLM panel. Applied to two corpora of website privacy policies, 123 collected in 2026 (OPPT) and 115 collected in 2015 (OPP-115), the pipeline finds the same category patterns recurring across the 11-year gap, with third-party sharing contradictions the majority of confirmed cases in each primary run, consistent with structural factors in policy composition rather than necessarily intentional deception. At least one panel-confirmed contradiction appears in 12.2% of OPPT companies (15/123; 9.8% excluding legacy pairs) and 36.5% of OPP-115 companies (42/115). A stability re-run seven months later, with a fully separated configuration (new extraction models, judges from three Chinese providers absent from both corpora, matched filters, no judge-submission similarity threshold), reproduces the OPPT prevalence under the original protocol (13.0% vs. 12.2%), finds sub-threshold pairs confirm at rates of the same order as those above (raising prevalence to 20.3% and 40.9%), and shows the third-party majority is panel-sensitive while the recurrence of the same category pairs is not. Two caveats govern all figures: panel verdicts are not validated against human expert judgment, so precision is unknown and prevalence figures are lower bounds; and the two primary runs used different filter configurations, so their prevalence difference is not interpretable as a corpus or era effect (the matched re-run reduces the gap to roughly twofold but does not eliminate it).
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 30 of its 111 references that are in the map. First posted on arXiv 2 Sep 2026.
Builds on
30 of 111 references.
References · 30
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
- 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,708
- 2017A Broad-Coverage Challenge Corpus for Sentence Understanding through Inferencecited by 2,682
- 2015A large annotated corpus for learning natural language inferencecited by 1,847
- 2021DeBERTaV3: Improving DeBERTa using ELECTRA-Style Pre-Training with Gradient-Disentangled Embedding Sharingcited by 1,254
- 2023Large Language Models are not Fair Evaluatorscited by 1,085
- 2019Right for the Wrong Reasons: Diagnosing Syntactic Heuristics in Natural Language Inferencecited by 876
- 2024LLM Evaluators Recognize and Favor Their Own Generationscited by 686
- 2018Annotation Artifacts in Natural Language Inference Datacited by 671
- 2024Replacing Judges with Juries: Evaluating LLM Generations with a Panel of Diverse Modelscited by 326
- 2021ContractNLI: A Dataset for Document-level Natural Language Inference for Contractscited by 148
18 more
- 2018CLAUDETTE: an Automated Detector of Potentially Unfair Clauses in Online Terms of Servicecited by 73
- 2019Question Answering for Privacy Policies: Combining Computational and Legal Perspectivescited by 67
- 2018Polisis: Automated Analysis and Presentation of Privacy Policies Using Deep Learningcited by 50
- 2020Privacy Policies over Time: Curation and Analysis of a Million-Document Datasetcited by 28
- 2020Dark Patterns after the GDPR: Scraping Consent Pop-ups and Demonstrating their Influencecited by 27
- 2020Privacy at Scale: Introducing the PrivaSeer Corpus of Web Privacy Policiescited by 22
- 2018The Privacy Policy Landscape After the GDPRcited by 18
- 2024Large Language Models: A New Approach for Privacy Policy Analysis at Scalecited by 14
- 2023ContraDoc: Understanding Self-Contradictions in Documents with Large Language Modelscited by 12
- 2018Automatic Detection of Vague Words and Sentences in Privacy Policiescited by 10
- 2022PoliGraph: Automated Privacy Policy Analysis using Knowledge Graphs (Journal Version)cited by 10
- 2021AI-enabled Automation for Completeness Checking of Privacy Policiescited by 7
- 2023ATLAS: Automatically Detecting Discrepancies Between Privacy Policies and Privacy Labelscited by 5
- 2025Explainable Compliance Detection with Multi-Hop Natural Language Inference on Assurance Case Structurecited by 5
- 2024PolicyLR: A Logic Representation For Privacy Policiescited by 3
- 2025Detecting Greenwashing: A Natural Language Processing Literature Surveycited by 1
- 2025Anonymity-washingcited by 1
- 2026Jurisdiction as Structural Barrier: How Privacy Policy Organization May Reduce Visibility of Substantive Disclosurescited by 1
Built on by
Not cited yet.