mlsanityData to 14 Oct 2026

Debiasing Without Protected Attributes: Latent Concept Erasure from Textual Profiles

arXiv 2606.12088 ↗First posted 10 Jun 2026cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

Most fairness research in NLP assumes direct access to protected attributes such as gender, race, or nationality. In practice, however, such information is often unavailable due to privacy constraints, missing metadata, or legal restrictions, even though models may infer it from indirect textual cues. This raises a key question: can debiasing succeed without direct access to sensitive attributes? We propose H-SAL, which performs post-hoc concept and attribute erasure using self-description text as an implicit debiasing signal. To support this setting, we introduce a multi-domain Stack Exchange-based fairness benchmark for helpfulness prediction that includes both explicit and implicit signals, enabling comparison between standard debiasing with protected labels and debiasing without access to sensitive information. Across encoder and decoder-only language models, we find that implicit self-description often matches or outperforms explicit-label-based debiasing. Our results broaden representation-level fairness research and provide a new benchmark for studying debiasing under realistic data constraints.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 20 of its 30 references that are in the map. First posted on arXiv 10 Jun 2026.

Builds on

20 of 30 references.

References · 20

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2024The Llama 3 Herd of Modelscited by 14,715
  3. 2020Null It Out: Guarding Protected Attributes by Iterative Nullspace Projectioncited by 455
  4. 2019Bias in Bios: A Case Study of Semantic Representation Bias in a High-Stakes Settingcited by 349
  5. 2023LEACE: Perfect linear concept erasure in closed formcited by 267
  6. 2017All-but-the-Top: Simple and Effective Postprocessing for Word Representationscited by 212
  7. 2018Adversarial Removal of Demographic Attributes from Text Datacited by 170
  8. 2018Learning to Ask Good Questions: Ranking Clarification Questions using Neural Expected Value of Perfect Informationcited by 115
  9. 2024Isambard-AI: a leadership class supercomputer optimised specifically for Artificial Intelligencecited by 62
  10. 2018Privacy-preserving Neural Representations of Textcited by 54
  11. 2019What's in a Name? Reducing Bias in Bios without Access to Protected Attributescited by 51
  12. 2022Kernelized Concept Erasurecited by 48
8 more
  1. 2021Text-to-SQL in the Wild: A Naturally-Occurring Dataset Based on Stack Exchange Datacited by 43
  2. 2022Gold Doesn't Always Glitter: Spectral Removal of Linear and Nonlinear Guarded Attribute Informationcited by 34
  3. 2018Proxy Fairnesscited by 29
  4. 2025Reading Between the Prompts: How Stereotypes Shape LLM's Implicit Personalizationcited by 24
  5. 2022BLIND: Bias Removal With No Demographicscited by 22
  6. 2025Sparse Activation Editing for Reliable Instruction Following in Narrativescited by 4
  7. 2026Differentiable Faithfulness Alignment for Cross-Model Circuit Transfercited by 3
  8. 2025Iterative Multilingual Spectral Attribute Erasurecited by 1

Built on by

Not cited yet.