Addressing Labelled Data Scarcity: Taxonomy-Agnostic Annotation of PII Values in HTTP Traffic using LLMs
Not on the map. Why?
Abstract (arXiv)
Automated privacy audits of web and mobile applications often analyse outbound HTTP traffic to detect Personally Identifiable Information (PII) leakage. However, existing learning-based detectors typically depend on scarce, manually labelled traffic and are tightly coupled to fixed label taxonomies, limiting transferability across domains and evolving definitions of PII. This paper investigates whether Large Language Models (LLMs) can support taxonomy-agnostic annotation of explicitly transmitted PII values in HTTP message bodies when the taxonomy is provided at runtime. We introduce a multi-stage LLM-based pipeline that combines deterministic pre-processing with label-level classification, targeted instance-level value annotation, and output validation. To enable controlled evaluation and exemplar-based prompting without relying on sensitive real-user captures, we further propose an LLM-based generator for synthetic HTTP traffic with manually validated, taxonomy-derived PII annotations. We evaluate the approach across three taxonomies spanning different PII domains and granularity levels. Results show that the pipeline accurately detects PII types and extracts corresponding values for concrete PII taxonomies. Overall, our findings position LLMs as a promising foundation for flexible, taxonomy-agnostic traffic annotation and for creating labelled data under evolving privacy taxonomies.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 11 of its 33 references that are in the map. First posted on arXiv 7 May 2026.
Builds on
11 of 33 references.
References · 11
- 2019Modeling Tabular data using Conditional GANcited by 699
- 2017Generating Multi-label Discrete Patient Records using Generative Adversarial Networkscited by 197
- 2023GPT-NER: Named Entity Recognition via Large Language Modelscited by 160
- 2025PII-Bench: Evaluating Query-Aware Privacy Protection Systemscited by 11
- 2015ReCon: Revealing and Controlling PII Leaks in Mobile Network Trafficcited by 9
- 2025Automated Privacy Information Annotation in Large Language Model Interactionscited by 6
- 2015Haystack: A Multi-Purpose Mobile Vantage Point in User Spacecited by 3
- 2024A Qualitative Analysis Framework for mHealth Privacy Practicescited by 2
- 2025Scalable multilingual PII annotation for responsible AI in LLMscited by 2
- 2017PrivacyProxy: Leveraging Crowdsourcing and In Situ Traffic Analysis to Detect and Mitigate Information Leakagecited by 1
- 2025Word-level Annotation of GDPR Transparency Compliance in Privacy Policies using Large Language Modelscited by 1
Built on by
Not cited yet.