mlsanityData to 7 Oct 2026

The Ethics of Interaction: Mitigating Security Threats in LLMs

arXiv 2401.12273 ↗First posted 22 Jan 2024cs.CR cs.AI cs.CLcited by 30

On the map: LLM safety and security → Safety alignment, refusal and guardrails

Abstract (arXiv)

This paper comprehensively explores the ethical challenges arising from security threats to Large Language Models (LLMs). These intricate digital repositories are increasingly integrated into our daily lives, making them prime targets for attacks that can compromise their training data and the confidentiality of their data sources. The paper delves into the nuanced ethical repercussions of such security threats on society and individual privacy. We scrutinize five major threats--prompt injection, jailbreaking, Personal Identifiable Information (PII) exposure, sexually explicit content, and hate-based content--going beyond mere identification to assess their critical ethical consequences and the urgency they create for robust defensive strategies. The escalating reliance on LLMs underscores the crucial need for ensuring these systems operate within the bounds of ethical norms, particularly as their misuse can lead to significant societal and individual harm. We propose conceptualizing and developing an evaluative tool tailored for LLMs, which would serve a dual purpose: guiding developers and designers in preemptive fortification of backend systems and scrutinizing the ethical dimensions of LLM chatbot responses during the testing phase. By comparing LLM responses with those expected from humans in a moral context, we aim to discern the degree to which AI behaviors align with the ethical values held by a broader society. Ultimately, this paper not only underscores the ethical troubles presented by LLMs; it also highlights a path toward cultivating trust in these systems.

Key facts. Cited by 30 papers in the map (data through 7 Oct 2026). Placed in Safety alignment, refusal and guardrails, one of 12 directions in LLM safety and security. Builds on 3 of its 6 references that are in the map. First posted on arXiv 22 Jan 2024.

Builds on

3 of 6 references.

References · 3

  1. 2023A Survey on Evaluation of Large Language Modelscited by 1,227
  2. 2023Red teaming ChatGPT via Jailbreaking: Bias, Robustness, Reliability and Toxicitycited by 86
  3. 2023Beyond the Safeguards: Exploring the Security Risks of ChatGPTcited by 36

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 16; 2025: 11; 2026: 3.

30 papers.

Sort:

By area:

  1. 2024From Persona to Personalization: A Survey on Role-Playing Language Agentscited by 206
  2. 2024Empowering Biomedical Discovery with AI Agentscited by 117
  3. 2024Introducing v0.5 of the AI Safety Benchmark from MLCommonscited by 60
  4. 2024VisDoM: Multi-Document QA with Visually Rich Elements Using Multimodal Retrieval-Augmented Generationcited by 40
  5. 2025Protecting Users From Themselves: Safeguarding Contextual Privacy in Interactions with Conversational Agentscited by 26
  6. 2025Integrating LLMs with ITS: Recent Advances, Potentials, Challenges, and Future Directionscited by 23
  7. 2024On Catastrophic Inheritance of Large Foundation Modelscited by 15
  8. 2024Swiss Cheese Model for AI Safety: A Taxonomy and Reference Architecture for Multi-Layered Guardrails of Foundation Model Based Agentscited by 13
  9. 2025UniGuardian: A Unified Defense for Detecting Prompt Injection, Backdoor Attacks and Adversarial Attacks in Large Language Modelscited by 12
  10. 2024Leveraging Large Language Models for Integrated Satellite-Aerial-Terrestrial Networks: Recent Advances and Future Directionscited by 10
  11. 2025LLLMs: A Data-Driven Survey of Evolving Research on Limitations of Large Language Modelscited by 9
  12. 2024DocEdit-v2: Document Structure Editing Via Multimodal LLM Groundingcited by 7
18 more
  1. 2025LARGO: Latent Adversarial Reflection through Gradient Optimization for Jailbreaking LLMscited by 7
  2. 2024Building a Domain-specific Guardrail Model in Productioncited by 6
  3. 2024CIPHER: Cybersecurity Intelligent Penetration-testing Helper for Ethical Researchercited by 6
  4. 2025aiXamine: Simplified LLM Safety and Securitycited by 4
  5. 2025Follow the Flow: Fine-grained Flowchart Attribution with Neurosymbolic Agentscited by 4
  6. 2024Surveying Attitudinal Alignment Between Large Language Models Vs. Humans Towards 17 Sustainable Development Goalscited by 3
  7. 2024From Intentions to Techniques: A Comprehensive Taxonomy and Challenges in Text Watermarking for Large Language Modelscited by 3
  8. 2024Logicbreaks: A Framework for Understanding Subversion of Rule-based Inferencecited by 3
  9. 2025ChartLens: Fine-grained Visual Attribution in Chartscited by 3
  10. 2025Localizing Persona Representations in LLMscited by 3
  11. 2025Helping Large Language Models Protect Themselves: An Enhanced Filtering and Summarization Systemcited by 2
  12. 2024CFSafety: Comprehensive Fine-grained Safety Assessment for LLMscited by 1
  13. 2024Quantifying Risk Propensities of Large Language Models: Ethical Focus and Bias Detection through Role-Playcited by 1
  14. 2026dgMARK: Decoding-Guided Watermarking for Diffusion Language Modelscited by 1
  15. 2024360Zhinao Technical Reportcited by 0
  16. 2025Personalisation or Prejudice? Addressing Geographic Bias in Hate Speech Detection using Debias Tuning in Large Language Modelscited by 0
  17. 2026Ethics Testing: Proactive Identification of Generative AI System Harmscited by 0
  18. 2026aiXamine: Unified Black-Box Evaluation of Cross-Dimensional Trade-offs in LLM Safety, Security, and Privacycited by 0