The Ethics of Interaction: Mitigating Security Threats in LLMs
On the map: LLM safety and security → Safety alignment, refusal and guardrails
Abstract (arXiv)
This paper comprehensively explores the ethical challenges arising from security threats to Large Language Models (LLMs). These intricate digital repositories are increasingly integrated into our daily lives, making them prime targets for attacks that can compromise their training data and the confidentiality of their data sources. The paper delves into the nuanced ethical repercussions of such security threats on society and individual privacy. We scrutinize five major threats--prompt injection, jailbreaking, Personal Identifiable Information (PII) exposure, sexually explicit content, and hate-based content--going beyond mere identification to assess their critical ethical consequences and the urgency they create for robust defensive strategies. The escalating reliance on LLMs underscores the crucial need for ensuring these systems operate within the bounds of ethical norms, particularly as their misuse can lead to significant societal and individual harm. We propose conceptualizing and developing an evaluative tool tailored for LLMs, which would serve a dual purpose: guiding developers and designers in preemptive fortification of backend systems and scrutinizing the ethical dimensions of LLM chatbot responses during the testing phase. By comparing LLM responses with those expected from humans in a moral context, we aim to discern the degree to which AI behaviors align with the ethical values held by a broader society. Ultimately, this paper not only underscores the ethical troubles presented by LLMs; it also highlights a path toward cultivating trust in these systems.
Key facts. Cited by 30 papers in the map (data through 7 Oct 2026). Placed in Safety alignment, refusal and guardrails, one of 12 directions in LLM safety and security. Builds on 3 of its 6 references that are in the map. First posted on arXiv 22 Jan 2024.
Builds on
3 of 6 references.
References · 3
- 2023A Survey on Evaluation of Large Language Modelscited by 1,227
- 2023Red teaming ChatGPT via Jailbreaking: Bias, Robustness, Reliability and Toxicitycited by 86
- 2023Beyond the Safeguards: Exploring the Security Risks of ChatGPTcited by 36
Built on by
Citing papers per year: 2024: 16; 2025: 11; 2026: 3.
30 papers.
Sort:
By area:
- 2024From Persona to Personalization: A Survey on Role-Playing Language Agentscited by 206
- 2024Empowering Biomedical Discovery with AI Agentscited by 117
- 2024Introducing v0.5 of the AI Safety Benchmark from MLCommonscited by 60
- 2024VisDoM: Multi-Document QA with Visually Rich Elements Using Multimodal Retrieval-Augmented Generationcited by 40
- 2025Protecting Users From Themselves: Safeguarding Contextual Privacy in Interactions with Conversational Agentscited by 26
- 2025Integrating LLMs with ITS: Recent Advances, Potentials, Challenges, and Future Directionscited by 23
- 2024On Catastrophic Inheritance of Large Foundation Modelscited by 15
- 2024Swiss Cheese Model for AI Safety: A Taxonomy and Reference Architecture for Multi-Layered Guardrails of Foundation Model Based Agentscited by 13
- 2025UniGuardian: A Unified Defense for Detecting Prompt Injection, Backdoor Attacks and Adversarial Attacks in Large Language Modelscited by 12
- 2024Leveraging Large Language Models for Integrated Satellite-Aerial-Terrestrial Networks: Recent Advances and Future Directionscited by 10
- 2025LLLMs: A Data-Driven Survey of Evolving Research on Limitations of Large Language Modelscited by 9
- 2024DocEdit-v2: Document Structure Editing Via Multimodal LLM Groundingcited by 7
18 more
- 2025LARGO: Latent Adversarial Reflection through Gradient Optimization for Jailbreaking LLMscited by 7
- 2024Building a Domain-specific Guardrail Model in Productioncited by 6
- 2024CIPHER: Cybersecurity Intelligent Penetration-testing Helper for Ethical Researchercited by 6
- 2025aiXamine: Simplified LLM Safety and Securitycited by 4
- 2025Follow the Flow: Fine-grained Flowchart Attribution with Neurosymbolic Agentscited by 4
- 2024Surveying Attitudinal Alignment Between Large Language Models Vs. Humans Towards 17 Sustainable Development Goalscited by 3
- 2024From Intentions to Techniques: A Comprehensive Taxonomy and Challenges in Text Watermarking for Large Language Modelscited by 3
- 2024Logicbreaks: A Framework for Understanding Subversion of Rule-based Inferencecited by 3
- 2025ChartLens: Fine-grained Visual Attribution in Chartscited by 3
- 2025Localizing Persona Representations in LLMscited by 3
- 2025Helping Large Language Models Protect Themselves: An Enhanced Filtering and Summarization Systemcited by 2
- 2024CFSafety: Comprehensive Fine-grained Safety Assessment for LLMscited by 1
- 2024Quantifying Risk Propensities of Large Language Models: Ethical Focus and Bias Detection through Role-Playcited by 1
- 2026dgMARK: Decoding-Guided Watermarking for Diffusion Language Modelscited by 1
- 2024360Zhinao Technical Reportcited by 0
- 2025Personalisation or Prejudice? Addressing Geographic Bias in Hate Speech Detection using Debias Tuning in Large Language Modelscited by 0
- 2026Ethics Testing: Proactive Identification of Generative AI System Harmscited by 0
- 2026aiXamine: Unified Black-Box Evaluation of Cross-Dimensional Trade-offs in LLM Safety, Security, and Privacycited by 0
- 2026aiXamine: Unified Black-Box Evaluation of Cross-Dimensional Trade-offs in LLM Safety, Security, and Privacy20 Aug 2026
- 2026Ethics Testing: Proactive Identification of Generative AI System Harms23 Apr 2026
- 2026dgMARK: Decoding-Guided Watermarking for Diffusion Language Models30 Jan 2026
- 2025Follow the Flow: Fine-grained Flowchart Attribution with Neurosymbolic Agents2 Jun 2025
- 2025Localizing Persona Representations in LLMs30 May 2025
- 2025ChartLens: Fine-grained Visual Attribution in Charts25 May 2025
- 2025LLLMs: A Data-Driven Survey of Evolving Research on Limitations of Large Language Models25 May 2025
- 2025LARGO: Latent Adversarial Reflection through Gradient Optimization for Jailbreaking LLMs16 May 2025
- 2025Personalisation or Prejudice? Addressing Geographic Bias in Hate Speech Detection using Debias Tuning in Large Language Models4 May 2025
- 2025Helping Large Language Models Protect Themselves: An Enhanced Filtering and Summarization System2 May 2025
- 2025aiXamine: Simplified LLM Safety and Security21 Apr 2025
- 2025Protecting Users From Themselves: Safeguarding Contextual Privacy in Interactions with Conversational Agents22 Feb 2025
18 more
- 2025UniGuardian: A Unified Defense for Detecting Prompt Injection, Backdoor Attacks and Adversarial Attacks in Large Language Models18 Feb 2025
- 2025Integrating LLMs with ITS: Recent Advances, Potentials, Challenges, and Future Directions8 Jan 2025
- 2024VisDoM: Multi-Document QA with Visually Rich Elements Using Multimodal Retrieval-Augmented Generation14 Dec 2024
- 2024CFSafety: Comprehensive Fine-grained Safety Assessment for LLMs29 Oct 2024
- 2024Quantifying Risk Propensities of Large Language Models: Ethical Focus and Bias Detection through Role-Play26 Oct 2024
- 2024DocEdit-v2: Document Structure Editing Via Multimodal LLM Grounding21 Oct 2024
- 2024CIPHER: Cybersecurity Intelligent Penetration-testing Helper for Ethical Researcher21 Aug 2024
- 2024Swiss Cheese Model for AI Safety: A Taxonomy and Reference Architecture for Multi-Layered Guardrails of Foundation Model Based Agents5 Aug 2024
- 2024Building a Domain-specific Guardrail Model in Production24 Jul 2024
- 2024Leveraging Large Language Models for Integrated Satellite-Aerial-Terrestrial Networks: Recent Advances and Future Directions5 Jul 2024
- 2024Logicbreaks: A Framework for Understanding Subversion of Rule-based Inference21 Jun 2024
- 2024From Intentions to Techniques: A Comprehensive Taxonomy and Challenges in Text Watermarking for Large Language Models17 Jun 2024
- 2024360Zhinao Technical Report22 May 2024
- 2024From Persona to Personalization: A Survey on Role-Playing Language Agents28 Apr 2024
- 2024Surveying Attitudinal Alignment Between Large Language Models Vs. Humans Towards 17 Sustainable Development Goals22 Apr 2024
- 2024Introducing v0.5 of the AI Safety Benchmark from MLCommons18 Apr 2024
- 2024Empowering Biomedical Discovery with AI Agents3 Apr 2024
- 2024On Catastrophic Inheritance of Large Foundation Models2 Feb 2024
- 2025UniGuardian: A Unified Defense for Detecting Prompt Injection, Backdoor Attacks and Adversarial Attacks in Large Language Modelscited by 12
- 2025LARGO: Latent Adversarial Reflection through Gradient Optimization for Jailbreaking LLMscited by 7
- 2024Building a Domain-specific Guardrail Model in Productioncited by 6
- 2025aiXamine: Simplified LLM Safety and Securitycited by 4
- 2024From Intentions to Techniques: A Comprehensive Taxonomy and Challenges in Text Watermarking for Large Language Modelscited by 3
- 2024Logicbreaks: A Framework for Understanding Subversion of Rule-based Inferencecited by 3
- 2025Helping Large Language Models Protect Themselves: An Enhanced Filtering and Summarization Systemcited by 2
- 2025LARGO: Latent Adversarial Reflection through Gradient Optimization for Jailbreaking LLMs16 May 2025
- 2025Helping Large Language Models Protect Themselves: An Enhanced Filtering and Summarization System2 May 2025
- 2025aiXamine: Simplified LLM Safety and Security21 Apr 2025
- 2025UniGuardian: A Unified Defense for Detecting Prompt Injection, Backdoor Attacks and Adversarial Attacks in Large Language Models18 Feb 2025
- 2024Building a Domain-specific Guardrail Model in Production24 Jul 2024
- 2024Logicbreaks: A Framework for Understanding Subversion of Rule-based Inference21 Jun 2024
- 2024From Intentions to Techniques: A Comprehensive Taxonomy and Challenges in Text Watermarking for Large Language Models17 Jun 2024
- 2024From Persona to Personalization: A Survey on Role-Playing Language Agentscited by 206
- 2025Protecting Users From Themselves: Safeguarding Contextual Privacy in Interactions with Conversational Agentscited by 26
- 2024Swiss Cheese Model for AI Safety: A Taxonomy and Reference Architecture for Multi-Layered Guardrails of Foundation Model Based Agentscited by 13
- 2025Follow the Flow: Fine-grained Flowchart Attribution with Neurosymbolic Agentscited by 4
- 2025Follow the Flow: Fine-grained Flowchart Attribution with Neurosymbolic Agents2 Jun 2025
- 2025Protecting Users From Themselves: Safeguarding Contextual Privacy in Interactions with Conversational Agents22 Feb 2025
- 2024Swiss Cheese Model for AI Safety: A Taxonomy and Reference Architecture for Multi-Layered Guardrails of Foundation Model Based Agents5 Aug 2024
- 2024From Persona to Personalization: A Survey on Role-Playing Language Agents28 Apr 2024
- 2025ChartLens: Fine-grained Visual Attribution in Charts25 May 2025
- 2024DocEdit-v2: Document Structure Editing Via Multimodal LLM Grounding21 Oct 2024
- 2024Empowering Biomedical Discovery with AI Agentscited by 117
- 2024Introducing v0.5 of the AI Safety Benchmark from MLCommonscited by 60
- 2025Integrating LLMs with ITS: Recent Advances, Potentials, Challenges, and Future Directionscited by 23
- 2024On Catastrophic Inheritance of Large Foundation Modelscited by 15
- 2024Leveraging Large Language Models for Integrated Satellite-Aerial-Terrestrial Networks: Recent Advances and Future Directionscited by 10
- 2025LLLMs: A Data-Driven Survey of Evolving Research on Limitations of Large Language Modelscited by 9
- 2024CIPHER: Cybersecurity Intelligent Penetration-testing Helper for Ethical Researchercited by 6
- 2024Surveying Attitudinal Alignment Between Large Language Models Vs. Humans Towards 17 Sustainable Development Goalscited by 3
- 2025Localizing Persona Representations in LLMscited by 3
- 2024CFSafety: Comprehensive Fine-grained Safety Assessment for LLMscited by 1
- 2024Quantifying Risk Propensities of Large Language Models: Ethical Focus and Bias Detection through Role-Playcited by 1
- 2024360Zhinao Technical Reportcited by 0
12 most cited of 14 All 14 (JSON)
- 2026Ethics Testing: Proactive Identification of Generative AI System Harms23 Apr 2026
- 2025Localizing Persona Representations in LLMs30 May 2025
- 2025LLLMs: A Data-Driven Survey of Evolving Research on Limitations of Large Language Models25 May 2025
- 2025Personalisation or Prejudice? Addressing Geographic Bias in Hate Speech Detection using Debias Tuning in Large Language Models4 May 2025
- 2025Integrating LLMs with ITS: Recent Advances, Potentials, Challenges, and Future Directions8 Jan 2025
- 2024CFSafety: Comprehensive Fine-grained Safety Assessment for LLMs29 Oct 2024
- 2024Quantifying Risk Propensities of Large Language Models: Ethical Focus and Bias Detection through Role-Play26 Oct 2024
- 2024CIPHER: Cybersecurity Intelligent Penetration-testing Helper for Ethical Researcher21 Aug 2024
- 2024Leveraging Large Language Models for Integrated Satellite-Aerial-Terrestrial Networks: Recent Advances and Future Directions5 Jul 2024
- 2024360Zhinao Technical Report22 May 2024
- 2024Surveying Attitudinal Alignment Between Large Language Models Vs. Humans Towards 17 Sustainable Development Goals22 Apr 2024
- 2024Introducing v0.5 of the AI Safety Benchmark from MLCommons18 Apr 2024
12 newest of 14 All 14 (JSON)