Beyond a Global Norm: Personalizing Toxicity Sensitivity in Language Models Without Retraining
Not on the map. Why?
Abstract (arXiv)
Reducing toxicity is often framed as a global alignment problem, yet perceptions of harmful language are subjective and context-dependent. We present the first comparative evaluation of training-free methods for aligning language generation to user-specific toxicity sensitivities across three inference-time intervention stages: pre-decoding (prompt conditioning and rewriting), in-decoding (token, logit, and representation steering), and post-decoding (candidate re-ranking). Evaluated against toxicity sensitivity targets derived from the PRISM dataset, all methods reduce alignment error by 28-47%. However, the results reveal a fundamental trade-off between alignment effectiveness, personalization, and general language quality, showing how toxicity sensitivity alignment is an inherently multi-objective problem.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 24 of its 40 references that are in the map. First posted on arXiv 25 Jul 2026.
Builds on
24 of 40 references.
References · 24
- 2022Training language models to follow instructions with human feedbackcited by 15,712
- 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
- 2020Measuring Massive Multitask Language Understandingcited by 7,768
- 2019Plug and Play Language Models: A Simple Approach to Controlled Text Generationcited by 793
- 2021DExperts: Decoding-Time Controlled Text Generation with Experts and Anti-Expertscited by 434
- 2020GeDi: Generative Discriminator Guided Sequence Generationcited by 377
- 2021FUDGE: Controlled Text Generation With Future Discriminatorscited by 374
- 2021Annotators with Attitudes: How Annotator Beliefs And Identities Bias Toxic Language Detectioncited by 258
- 2023Defending Against Alignment-Breaking Attacks via Robustly Aligned LLMcited by 173
- 2021MultiVerS: Improving scientific claim verification with weak supervision and full-document contextcited by 140
- 2023Black-Box Prompt Optimization: Aligning Large Language Models without Model Trainingcited by 122
- 2024Personalized Steering of Large Language Models: Versatile Steering Vectors Through Bi-directional Preference Optimizationcited by 112
12 more
- 2024Aligner: Efficient Alignment by Learning to Correctcited by 96
- 2022Handling Bias in Toxic Speech Detection: A Surveycited by 60
- 2022Multilingual HateCheck: Functional Tests for Multilingual Hate Speech Detection Modelscited by 51
- 2024Preference Tuning For Toxicity Mitigation Generalizes Across Languagescited by 31
- 2025Taxonomy, Opportunities, and Challenges of Representation Engineering for Large Language Modelscited by 29
- 2023Goodtriever: Adaptive Toxicity Mitigation with Retrieval-augmented Modelscited by 23
- 2024Subjective textitIsms? On the Danger of Conflating Hate and Offence in Abusive Language Detectioncited by 9
- 2024Adversarial DPO: Harnessing Harmful Data for Reducing Toxicity with Minimal Impact on Coherence and Evasiveness in Dialogue Agentscited by 6
- 2024DefVerify: Do Hate Speech Models Reflect Their Dataset's Definition?cited by 6
- 2025Re-ranking Using Large Language Models for Mitigating Exposure to Harmful Content on Social Media Platformscited by 2
- 2025Steering Large Language Models for Machine Translation Personalizationcited by 2
- 2026"Label from Somewhere": Reflexive Annotating for Situated AI Alignmentcited by 2
Built on by
Not cited yet.