mlsanityData to 7 Oct 2026

Beyond a Global Norm: Personalizing Toxicity Sensitivity in Language Models Without Retraining

arXiv 2607.23175 ↗First posted 25 Jul 2026cs.CL cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Reducing toxicity is often framed as a global alignment problem, yet perceptions of harmful language are subjective and context-dependent. We present the first comparative evaluation of training-free methods for aligning language generation to user-specific toxicity sensitivities across three inference-time intervention stages: pre-decoding (prompt conditioning and rewriting), in-decoding (token, logit, and representation steering), and post-decoding (candidate re-ranking). Evaluated against toxicity sensitivity targets derived from the PRISM dataset, all methods reduce alignment error by 28-47%. However, the results reveal a fundamental trade-off between alignment effectiveness, personalization, and general language quality, showing how toxicity sensitivity alignment is an inherently multi-objective problem.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 24 of its 40 references that are in the map. First posted on arXiv 25 Jul 2026.

Builds on

24 of 40 references.

References · 24

  1. 2022Training language models to follow instructions with human feedbackcited by 15,712
  2. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
  3. 2020Measuring Massive Multitask Language Understandingcited by 7,768
  4. 2019Plug and Play Language Models: A Simple Approach to Controlled Text Generationcited by 793
  5. 2021DExperts: Decoding-Time Controlled Text Generation with Experts and Anti-Expertscited by 434
  6. 2020GeDi: Generative Discriminator Guided Sequence Generationcited by 377
  7. 2021FUDGE: Controlled Text Generation With Future Discriminatorscited by 374
  8. 2021Annotators with Attitudes: How Annotator Beliefs And Identities Bias Toxic Language Detectioncited by 258
  9. 2023Defending Against Alignment-Breaking Attacks via Robustly Aligned LLMcited by 173
  10. 2021MultiVerS: Improving scientific claim verification with weak supervision and full-document contextcited by 140
  11. 2023Black-Box Prompt Optimization: Aligning Large Language Models without Model Trainingcited by 122
  12. 2024Personalized Steering of Large Language Models: Versatile Steering Vectors Through Bi-directional Preference Optimizationcited by 112
12 more
  1. 2024Aligner: Efficient Alignment by Learning to Correctcited by 96
  2. 2022Handling Bias in Toxic Speech Detection: A Surveycited by 60
  3. 2022Multilingual HateCheck: Functional Tests for Multilingual Hate Speech Detection Modelscited by 51
  4. 2024Preference Tuning For Toxicity Mitigation Generalizes Across Languagescited by 31
  5. 2025Taxonomy, Opportunities, and Challenges of Representation Engineering for Large Language Modelscited by 29
  6. 2023Goodtriever: Adaptive Toxicity Mitigation with Retrieval-augmented Modelscited by 23
  7. 2024Subjective textitIsms? On the Danger of Conflating Hate and Offence in Abusive Language Detectioncited by 9
  8. 2024Adversarial DPO: Harnessing Harmful Data for Reducing Toxicity with Minimal Impact on Coherence and Evasiveness in Dialogue Agentscited by 6
  9. 2024DefVerify: Do Hate Speech Models Reflect Their Dataset's Definition?cited by 6
  10. 2025Re-ranking Using Large Language Models for Mitigating Exposure to Harmful Content on Social Media Platformscited by 2
  11. 2025Steering Large Language Models for Machine Translation Personalizationcited by 2
  12. 2026"Label from Somewhere": Reflexive Annotating for Situated AI Alignmentcited by 2

Built on by

Not cited yet.