LifeTox: Unveiling Implicit Toxicity in Life Advice
Not on the map. Why?
Abstract (arXiv)
As large language models become increasingly integrated into daily life, detecting implicit toxicity across diverse contexts is crucial. To this end, we introduce LifeTox, a dataset designed for identifying implicit toxicity within a broad range of advice-seeking scenarios. Unlike existing safety datasets, LifeTox comprises diverse contexts derived from personal experiences through open-ended questions. Experiments demonstrate that RoBERTa fine-tuned on LifeTox matches or surpasses the zero-shot performance of large language models in toxicity classification tasks. These results underscore the efficacy of LifeTox in addressing the complex challenges inherent in implicit toxicity. We open-sourced the datasetfootnoteurlhttps://huggingface.co/datasets/mbkim/LifeTox and the LifeTox moderator family; 350M, 7B, and 13B.
Key facts. Cited by 14 papers in the map (data through 7 Oct 2026). Builds on 28 of its 53 references that are in the map. First posted on arXiv 16 Nov 2023.
Builds on
28 of 53 references.
References · 28
- 2022Training language models to follow instructions with human feedbackcited by 15,712
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
- 2021On the Opportunities and Risks of Foundation Modelscited by 3,961
- 2022Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedbackcited by 3,634
- 2021A General Language Assistant as a Laboratory for Alignmentcited by 1,023
- 2022Red Teaming Language Models with Language Modelscited by 983
- 2020StereoSet: Measuring stereotypical bias in pretrained language modelscited by 911
- 2023BeaverTails: Towards Improved Safety Alignment of LLM via a Human-Preference Datasetcited by 828
- 2020Aligning AI With Shared Human Valuescited by 706
- 2022Red Teaming Language Models to Reduce Harms: Methods, Scaling Behaviors, and Lessons Learnedcited by 702
- 2023Bias and Fairness in Large Language Models: A Surveycited by 626
16 more
- 2023Prometheus: Inducing Fine-grained Evaluation Capability in Language Modelscited by 558
- 2022ToxiGen: A Large-Scale Machine-Generated Dataset for Adversarial and Implicit Hate Speech Detectioncited by 419
- 2018QuAC : Question Answering in Contextcited by 379
- 2019Social Bias Frames: Reasoning about Social and Power Implications of Languagecited by 377
- 2023Toxicity in ChatGPT: Analyzing Persona-assigned Language Modelscited by 356
- 2023Shadow Alignment: The Ease of Subverting Safely-Aligned Language Modelscited by 284
- 2021Latent Hatred: A Benchmark for Understanding Implicit Hate Speechcited by 216
- 2023Red-Teaming Large Language Models using Chain of Utterances for Safety-Alignmentcited by 213
- 2022On Second Thought, Let's Not Think Step by Step! Bias and Toxicity in Zero-Shot Reasoningcited by 191
- 2023Do-Not-Answer: A Dataset for Evaluating Safeguards in LLMscited by 176
- 2021Hurdles to Progress in Long-form Question Answeringcited by 166
- 2020Toxicity Detection: Does Context Really Matter?cited by 93
- 2022Handling Bias in Toxic Speech Detection: A Surveycited by 60
- 2022Critic-Guided Decoding for Controlled Text Generationcited by 45
- 2023SQuARe: A Large-Scale Dataset of Sensitive Questions and Acceptable Responses Created Through Human-Machine Collaborationcited by 13
- 2023DELPHI: Data for Evaluating LLMs' Performance in Handling Controversial Issuescited by 11
Built on by
Citing papers per year: 2024: 5; 2025: 5; 2026: 4.
14 papers.
Sort:
By area:
- 2024Attacks, Defenses and Evaluations for LLM Conversation Safety: A Surveycited by 124
- 2024VLind-Bench: Measuring Language Priors in Large Vision-Language Modelscited by 44
- 2025The State of Multilingual LLM Safety Research: From Measuring the Language Gap to Mitigating Itcited by 42
- 2025The Scales of Justitia: A Comprehensive Survey on Safety Evaluation of LLMscited by 24
- 2025Drift: Decoding-time Personalized Alignments with Implicit User Preferencescited by 13
- 2026CausalArmor: Efficient Indirect Prompt Injection Guardrails via Causal Attributioncited by 13
- 2024AdvisorQA: Towards Helpful and Harmless Advice-seeking Question Answering with Collective Intelligencecited by 12
- 2024SWITCH: Studying with Teacher for Knowledge Distillation of Large Language Modelscited by 8
- 2025What Really Matters in Many-Shot Attacks? An Empirical Study of Long-Context Vulnerabilities in LLMscited by 7
- 2025Mitigating Biases in Language Models via Bias Unlearningcited by 6
- 2024Can Language Models Evaluate Human Written Text? Case Study on Korean Student Writing for Educationcited by 4
- 2026MHSafeEval: Role-Aware Interaction-Level Evaluation of Mental Health Safety in Large Language Modelscited by 3
- 2026A Survey of Toxicity Detection and Mitigation Strategies for Multilingual Language Models24 Jun 2026
- 2026LiSA: Lifelong Safety Adaptation via Conservative Policy Induction14 May 2026
- 2026MHSafeEval: Role-Aware Interaction-Level Evaluation of Mental Health Safety in Large Language Models20 Apr 2026
- 2026CausalArmor: Efficient Indirect Prompt Injection Guardrails via Causal Attribution8 Feb 2026
- 2025Mitigating Biases in Language Models via Bias Unlearning30 Sep 2025
- 2025The Scales of Justitia: A Comprehensive Survey on Safety Evaluation of LLMs6 Jun 2025
- 2025The State of Multilingual LLM Safety Research: From Measuring the Language Gap to Mitigating It30 May 2025
- 2025What Really Matters in Many-Shot Attacks? An Empirical Study of Long-Context Vulnerabilities in LLMs26 May 2025
- 2025Drift: Decoding-time Personalized Alignments with Implicit User Preferences20 Feb 2025
- 2024SWITCH: Studying with Teacher for Knowledge Distillation of Large Language Models25 Oct 2024
- 2024Can Language Models Evaluate Human Written Text? Case Study on Korean Student Writing for Education24 Jul 2024
- 2024VLind-Bench: Measuring Language Priors in Large Vision-Language Models13 Jun 2024
- 2025The State of Multilingual LLM Safety Research: From Measuring the Language Gap to Mitigating Itcited by 42
- 2025What Really Matters in Many-Shot Attacks? An Empirical Study of Long-Context Vulnerabilities in LLMscited by 7
- 2025Mitigating Biases in Language Models via Bias Unlearningcited by 6
- 2026LiSA: Lifelong Safety Adaptation via Conservative Policy Inductioncited by 1
- 2026A Survey of Toxicity Detection and Mitigation Strategies for Multilingual Language Modelscited by 0
- 2026A Survey of Toxicity Detection and Mitigation Strategies for Multilingual Language Models24 Jun 2026
- 2026LiSA: Lifelong Safety Adaptation via Conservative Policy Induction14 May 2026
- 2025Mitigating Biases in Language Models via Bias Unlearning30 Sep 2025
- 2025The State of Multilingual LLM Safety Research: From Measuring the Language Gap to Mitigating It30 May 2025
- 2025What Really Matters in Many-Shot Attacks? An Empirical Study of Long-Context Vulnerabilities in LLMs26 May 2025
- 2024Attacks, Defenses and Evaluations for LLM Conversation Safety: A Surveycited by 124
- 2025The Scales of Justitia: A Comprehensive Survey on Safety Evaluation of LLMscited by 24
- 2024AdvisorQA: Towards Helpful and Harmless Advice-seeking Question Answering with Collective Intelligencecited by 12
- 2024SWITCH: Studying with Teacher for Knowledge Distillation of Large Language Modelscited by 8
- 2024Can Language Models Evaluate Human Written Text? Case Study on Korean Student Writing for Educationcited by 4
- 2026MHSafeEval: Role-Aware Interaction-Level Evaluation of Mental Health Safety in Large Language Modelscited by 3
- 2026MHSafeEval: Role-Aware Interaction-Level Evaluation of Mental Health Safety in Large Language Models20 Apr 2026
- 2025The Scales of Justitia: A Comprehensive Survey on Safety Evaluation of LLMs6 Jun 2025
- 2024SWITCH: Studying with Teacher for Knowledge Distillation of Large Language Models25 Oct 2024
- 2024Can Language Models Evaluate Human Written Text? Case Study on Korean Student Writing for Education24 Jul 2024
- 2024AdvisorQA: Towards Helpful and Harmless Advice-seeking Question Answering with Collective Intelligence18 Apr 2024
- 2024Attacks, Defenses and Evaluations for LLM Conversation Safety: A Survey14 Feb 2024