Human-Centered Privacy Research in the Age of Large Language Models
Not on the map. Why?
Abstract (arXiv)
The emergence of large language models (LLMs), and their increased use in user-facing systems, has led to substantial privacy concerns. To date, research on these privacy concerns has been model-centered: exploring how LLMs lead to privacy risks like memorization, or can be used to infer personal characteristics about people from their content. We argue that there is a need for more research focusing on the human aspect of these privacy issues: e.g., research on how design paradigms for LLMs affect users' disclosure behaviors, users' mental models and preferences for privacy controls, and the design of tools, systems, and artifacts that empower end-users to reclaim ownership over their personal data. To build usable, efficient, and privacy-friendly systems powered by these models with imperfect privacy properties, our goal is to initiate discussions to outline an agenda for conducting human-centered research on privacy issues in LLM-powered systems. This Special Interest Group (SIG) aims to bring together researchers with backgrounds in usable security and privacy, human-AI collaboration, NLP, or any other related domains to share their perspectives and experiences on this problem, to help our community establish a collective understanding of the challenges, research opportunities, research methods, and strategies to collaborate with researchers outside of HCI.
Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Builds on 8 of its 22 references that are in the map. First posted on arXiv 3 Feb 2024.
Builds on
8 of 22 references.
References · 8
- 2020Extracting Training Data from Large Language Modelscited by 2,144
- 2021Asleep at the Keyboard? Assessing the Security of GitHub Copilot's Code Contributionscited by 417
- 2023Scalable Extraction of Training Data from (Production) Language Modelscited by 415
- 2023Can LLMs Keep a Secret? Testing Privacy Implications of Language Models via Contextual Integrity Theorycited by 218
- 2021Counterfactual Memorization in Neural Language Modelscited by 155
- 2022Is GitHub's Copilot as Bad as Humans at Introducing Vulnerabilities in Code?cited by 63
- 2023"It's a Fair Game", or Is It? Examining How Users Navigate Disclosure Risks and Benefits When Using LLM-Based Conversational Agentscited by 60
- 2023Can Language Models be Instructed to Protect Personal Information?cited by 46
Built on by
Citing papers per year: 2024: 3; 2025: 6.
9 papers.
- 2024Rescriber: Smaller-LLM-Powered User-Led Data Minimization for LLM-Based Chatbotscited by 16
- 2024Position: Towards Bidirectional Human-AI Alignmentcited by 15
- 2024Embedding Large Language Models into Extended Reality: Opportunities and Challenges for Inclusion, Engagement, and Privacycited by 14
- 2025LLM-as-a-Judge for Privacy Evaluation? Exploring the Alignment of Human and LLM Perceptions of Privacy in Textual Datacited by 10
- 2025DUET: Optimizing Training Data Mixtures via Feedback from Unseen Evaluation Taskscited by 6
- 2025Beyond Data Privacy: New Privacy Risks for Large Language Modelscited by 6
- 2025StorySage: Conversational Autobiography Writing Powered by a Multi-Agent Frameworkcited by 4
- 2025Designing Beyond Language: Sociotechnical Barriers in AI Health Technologies for Limited English Proficiencycited by 1
- 2025One Size Fits All? A Modular Adaptive Sanitization Kit (MASK) for Customizable Privacy-Preserving Phone Scam Detectioncited by 0
- 2025Designing Beyond Language: Sociotechnical Barriers in AI Health Technologies for Limited English Proficiency10 Nov 2025
- 2025One Size Fits All? A Modular Adaptive Sanitization Kit (MASK) for Customizable Privacy-Preserving Phone Scam Detection21 Oct 2025
- 2025Beyond Data Privacy: New Privacy Risks for Large Language Models16 Sep 2025
- 2025LLM-as-a-Judge for Privacy Evaluation? Exploring the Alignment of Human and LLM Perceptions of Privacy in Textual Data16 Aug 2025
- 2025StorySage: Conversational Autobiography Writing Powered by a Multi-Agent Framework17 Jun 2025
- 2025DUET: Optimizing Training Data Mixtures via Feedback from Unseen Evaluation Tasks1 Feb 2025
- 2024Rescriber: Smaller-LLM-Powered User-Led Data Minimization for LLM-Based Chatbots10 Oct 2024
- 2024Position: Towards Bidirectional Human-AI Alignment13 Jun 2024
- 2024Embedding Large Language Models into Extended Reality: Opportunities and Challenges for Inclusion, Engagement, and Privacy6 Feb 2024