DialogPII: A multilingual dataset of synthetic dialog transcripts to detect personal information
Not on the map. Why?
Abstract (arXiv)
Conversational data collected in domains such as healthcare or social sciences is a valuable resource for research and automated analysis. However, responsible data sharing requires the detection and removal of personally identifiable and sensitive information to protect individual privacy. To support the development and evaluation of automatic de-identification systems, we present DialogPII, a multilingual dataset of synthetic dialogs and speech-derived transcripts for personal information detection. DialogPII covers eight interaction scenarios (emergency calls, medical anamnesis interviews, therapy sessions, insurance communication, customer support, clinical interviews regarding an AI-supported dashboard, police reports, and group therapy discussions), 19 entity types, and 11 languages (English, Arabic, Finnish, French, German, Hindi, Italian, Polish, Portuguese, Spanish, and Turkish). Dialogs were generated semi-automatically using large language models, manually curated for plausibility and diversity, and localized to country- and city-specific contexts. All dialogs were additionally converted to speech via text-to-speech synthesis, transcribed with Whisper, and annotated through automatic projection and manual correction, yielding aligned written and speech-derived resources across all languages. We further release baseline multilingual named entity recognition models and provide technical validation through inter-annotator agreement analysis, translation quality evaluation, annotation projection assessment, and benchmark experiments with transformer-based sequence labeling models.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 14 of its 32 references that are in the map. First posted on arXiv 29 Jun 2026.
Builds on
14 of 32 references.
References · 14
- 2024Smarter, Better, Faster, Longer: A Modern Bidirectional Encoder for Fast, Memory Efficient, and Long Context Finetuning and Inferencecited by 554
- 2023WhisperX: Time-Accurate Speech Transcription of Long-Form Audiocited by 326
- 2024On LLMs-Driven Synthetic Data Generation, Curation, and Evaluation: A Surveycited by 244
- 2022The Text Anonymization Benchmark (TAB): A Dedicated Corpus and Evaluation Framework for Text Anonymizationcited by 95
- 2016De-identification of Patient Notes with Recurrent Neural Networkscited by 88
- 2020FLERT: Document-Level Features for Named Entity Recognitioncited by 45
- 2025mmBERT: A Modern Multilingual Encoder with Annealed Language Learningcited by 45
- 2023SemEval-2023 Task 2: Fine-grained Multilingual Named Entity Recognition (MultiCoNER 2)cited by 17
- 2019Audio De-identification: A New Entity Recognition Taskcited by 16
- 2022Named Entity Recognition for Audio De-Identificationcited by 4
- 2025Content Anonymization for Privacy in Long-form Audiocited by 3
- 2026MultiGraSCCo: A Multilingual Anonymization Benchmark with Annotations of Personal Identifierscited by 3
2 more
- 2023Trustera: A Live Conversation Redaction Systemcited by 2
- 2025Scalable multilingual PII annotation for responsible AI in LLMscited by 2
Built on by
Citing papers per year: 2026: 1.
1 paper.
- 2026Strong Multilingual Privacy Tagging at Encoder Speedcited by 0
- 2026Strong Multilingual Privacy Tagging at Encoder Speed29 Sep 2026