mlsanityData to 7 Oct 2026

Putting Privacy to the Test: Introducing Red Teaming for Research Data Anonymization

arXiv 2601.19575 ↗First posted 27 Jan 2026cs.HCcited by 0

On the map: LLM safety and security → Prompt injection and agent security

Abstract (arXiv)

Recently, the data protection practices of researchers in human-computer interaction and elsewhere have gained attention. Initial results suggest that researchers struggle with anonymization, partly due to a lack of clear, actionable guidance. In this work, we propose simulating re-identification attacks using the approach of red teaming versus blue teaming: a technique commonly employed in security testing, where one team tries to re-identify data, and the other team tries to prevent it. We discuss our experience applying this method to data collected in a mixed-methods study in human-centered privacy. We present usable materials for researchers to apply red teaming when anonymizing and publishing their studies' data.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Prompt injection and agent security, one of 12 directions in LLM safety and security. First posted on arXiv 27 Jan 2026.

Builds on

No reference list yet.

Built on by

Not cited yet.