# AWED-PIPER: Agents, Web Applications & Expert Detectors for Personally Identifiable Information Protection & Fine-grained Named Entity Recognition across 36 languages for 6.6 Billion Speakers

arXiv: https://arxiv.org/abs/2601.10161 · HTML: https://mlsanity.com/paper/2601.10161/

## Key facts

- No citing papers in the map yet (data through 14 Oct 2026).
- Builds on 12 of its 37 references that are in the map.
- First posted on arXiv 15 Jan 2026.

## Builds on (most cited first, 12 of 12)

- [Unsupervised Cross-lingual Representation Learning at Scale](https://mlsanity.com/paper/1911.02116/) (2019)
- [Stanza: A Python Natural Language Processing Toolkit for Many Human Languages](https://mlsanity.com/paper/2003.07082/) (2020)
- [MuRIL: Multilingual Representations for Indian Languages](https://mlsanity.com/paper/2103.10730/) (2021)
- [Gradio: Hassle-Free Sharing and Testing of ML Models in the Wild](https://mlsanity.com/paper/1906.02569/) (2019)
- [Few-NERD: A Few-Shot Named Entity Recognition Dataset](https://mlsanity.com/paper/2105.07464/) (2021)
- [Towards Leaving No Indic Language Behind: Building Monolingual Corpora, Benchmark and Models for Indic Languages](https://mlsanity.com/paper/2212.05409/) (2022)
- [Naamapadam: A Large-Scale Named Entity Annotated Data for Indic Languages](https://mlsanity.com/paper/2212.10168/) (2022)
- [L3Cube-MahaNER: A Marathi Named Entity Recognition Dataset and BERT models](https://mlsanity.com/paper/2204.06029/) (2022)
- [HiNER: A Large Hindi Named Entity Recognition Dataset](https://mlsanity.com/paper/2204.13743/) (2022)
- [A Finnish News Corpus for Named Entity Recognition](https://mlsanity.com/paper/1908.04212/) (2019)
- [You Get What You Chat: Using Conversations to Personalize Search-based Recommendations](https://mlsanity.com/paper/2109.04716/) (2021)
- [NameTag 3: A Tool and a Service for Multilingual/Multitagset NER](https://mlsanity.com/paper/2506.05949/) (2025)

## Abstract (arXiv)

Named Entity Recognition (NER) and Personally Identifiable Information (PII) anonymization are critical tasks in Natural Language Processing (NLP) for information extraction and privacy preservation. We introduce AWED-PIPER, an open-source framework comprising agentic tools, interactive web applications, and 54 state-of-the-art expert detector models that provide unified Fine-grained Named Entity Recognition (FgNER) and reversible synthetic PII pseudonymization across 36 languages spoken by over 6.6 billion people. The system couples fine-grained multilingual sequence labeling with script-aware regex detectors to identify contextual entities (Person, Location, Organization, Medical) as well as structured technical PII (Emails, native-script Phone Numbers, IP Addresses, Credit Cards). AWED-PIPER offers a dual capability: full FgNER entity extraction and privacy-preserving reversible anonymization with persistent placeholders and de-anonymization dictionary mappings. The suite spans global languages to extremely low-resource vulnerable languages like Bodo, Manipuri, Bishnupriya, and Mizo. The resources can be accessed here: PII Protector Agentic Tool: (https://github.com/PrachuryyaKaushik/AWED-PIPER), FgNER Agentic Tool: (https://github.com/PrachuryyaKaushik/AWED-FiNER), PII Web Application: (https://hf.co/spaces/prachuryyaIITG/AWED_PII_Protector), FgNER Web Application: (https://hf.co/spaces/prachuryyaIITG/AWED-FiNER), and Edge-deployable Expert Detector Models: (https://hf.co/collections/prachuryyaIITG/awed-piper).