Helping Large Language Models Protect Themselves: An Enhanced Filtering and Summarization System
On the map: LLM safety and security → Prompt injection and agent security
Abstract (arXiv)
The recent growth in the use of Large Language Models has made them vulnerable to sophisticated adversarial assaults, manipulative prompts, and encoded malicious inputs. Existing countermeasures frequently necessitate retraining models, which is computationally costly and impracticable for deployment. Without the need for retraining or fine-tuning, this study presents a unique defense paradigm that allows LLMs to recognize, filter, and defend against adversarial or malicious inputs on their own. There are two main parts to the suggested framework: (1) A prompt filtering module that uses sophisticated Natural Language Processing (NLP) techniques, including zero-shot classification, keyword analysis, and encoded content detection (e.g. base64, hexadecimal, URL encoding), to detect, decode, and classify harmful inputs; and (2) A summarization module that processes and summarizes adversarial research literature to give the LLM context-aware defense knowledge. This approach strengthens LLMs' resistance to adversarial exploitation by fusing text extraction, summarization, and harmful prompt analysis. According to experimental results, this integrated technique has a 98.71% success rate in identifying harmful patterns, manipulative language structures, and encoded prompts. By employing a modest amount of adversarial research literature as context, the methodology also allows the model to react correctly to harmful inputs with a larger percentage of jailbreak resistance and refusal rate. While maintaining the quality of LLM responses, the framework dramatically increases LLM's resistance to hostile misuse, demonstrating its efficacy as a quick and easy substitute for time-consuming, retraining-based defenses.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in Prompt injection and agent security, one of 12 directions in LLM safety and security. Builds on 58 of its 82 references that are in the map. First posted on arXiv 2 May 2025.
Builds on
58 of 82 references.
Closest ancestors · 6
Same direction, newest first
- 2024Embedding-based classifiers can detect prompt injection attacks29 Oct
- 2024StruQ: Defending Against Prompt Injection with Structured Queries9 Feb
- 2024HarmBench: A Standardized Evaluation Framework for Automated Red Teaming and Robust Refusal6 Feb
- 2023Benchmarking and Defending Against Indirect Prompt Injection Attacks on Large Language Models21 Dec
- 2023LLM Self Defense: By Self Examination, LLMs Know They Are Being Tricked14 Aug
- 2023Prompt Injection attack against LLM-integrated Applications8 Jun
Other references · 52
- 2024The Llama 3 Herd of Modelscited by 14,715
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
- 2023Qwen Technical Reportcited by 3,344
- 2023Universal and Transferable Adversarial Attacks on Aligned Language Modelscited by 3,104
- 2023A Survey of Large Language Modelscited by 2,576
- 2024Gemma 2: Improving Open Language Models at a Practical Sizecited by 1,998
- 2023Jailbroken: How Does LLM Safety Training Fail?cited by 1,651
- 2023Fine-tuning Aligned Language Models Compromises Safety, Even When Users Do Not Intend To!cited by 1,154
- 2023Open Problems and Fundamental Limitations of Reinforcement Learning from Human Feedbackcited by 759
- 2023Safe RLHF: Safe Reinforcement Learning from Human Feedbackcited by 656
- 2023GPTFUZZER: Red Teaming Large Language Models with Auto-Generated Jailbreak Promptscited by 560
- 2021Datasets: A Community Library for Natural Language Processingcited by 530
38 more
- 2024Large Language Models: A Surveycited by 525
- 2023"Do Anything Now": Characterizing and Evaluating In-The-Wild Jailbreak Prompts on Large Language Modelscited by 489
- 2023Trustworthy LLMs: a Survey and Guideline for Evaluating Large Language Models' Alignmentcited by 401
- 2023Role-Play with Large Language Modelscited by 294
- 2024TrustLLM: Trustworthiness in Large Language Modelscited by 285
- 2020Learning from the Worst: Dynamically Generated Datasets to Improve Online Hate Detectioncited by 221
- 2023Survey of Vulnerabilities in Large Language Models Revealed by Adversarial Attackscited by 194
- 2023MasterKey: Automated Jailbreak Across Multiple Large Language Model Chatbotscited by 183
- 2024Latent Adversarial Training Improves Robustness to Persistent Harmful Behaviors in LLMscited by 173
- 2024The Good and The Bad: Exploring Privacy Issues in Retrieval-Augmented Generation (RAG)cited by 159
- 2024LLM Defenses Are Not Robust to Multi-Turn Human Jailbreaks Yetcited by 151
- 2024Is LLM-as-a-Judge Robust? Investigating Universal Adversarial Attacks on Zero-shot LLM Assessmentcited by 126
- 2024Efficient Adversarial Training in LLMs with Continuous Attackscited by 113
- 2024ALERT: A Comprehensive Benchmark for Assessing Large Language Models' Safety through Red Teamingcited by 98
- 2023LLMs Cannot Reliably Identify and Reason About Security Vulnerabilities (Yet?): A Comprehensive Evaluation, Framework, and Benchmarkscited by 97
- 2024Chain of Attack: a Semantic-Driven Contextual Multi-Turn attacker for LLMcited by 77
- 2024Defending Large Language Models against Jailbreak Attacks via Semantic Smoothingcited by 74
- 2024The Ultimate Guide to Fine-Tuning LLMs from Basics to Breakthroughs: An Exhaustive Review of Technologies, Research, Best Practices, Applied Research Challenges and Opportunitiescited by 64
- 2024Understanding LLMs: A Comprehensive Overview from Training to Inferencecited by 59
- 2024ALLaM: Large Language Models for Arabic and Englishcited by 55
- 2024Breaking Down the Defenses: A Comparative Survey of Attacks on Large Language Modelscited by 44
- 2024Prompt Stealing Attacks Against Large Language Modelscited by 40
- 2023Knowledge Sanitization of Large Language Modelscited by 37
- 2024Securing Large Language Models: Threats, Vulnerabilities and Responsible Practicescited by 37
- 2024The Ethics of Interaction: Mitigating Security Threats in LLMscited by 33
- 2024A Comprehensive Overview of Large Language Models (LLMs) for Cyber Defences: Opportunities and Directionscited by 33
- 2020Stopwords in Technical Language Processingcited by 29
- 2024Fine Tuning LLM for Enterprise: Practical Guidelines and Recommendationscited by 28
- 2024Towards Resilient and Efficient LLMs: A Comparative Study of Efficiency, Performance, and Adversarial Robustnesscited by 22
- 2024VibeCheck: Discover and Quantify Qualitative Differences in Large Language Modelscited by 17
- 2024A Comparative Study of Quality Evaluation Methods for Text Summarizationcited by 13
- 2023AI in the Gray: Exploring Moderation Policies in Dialogic Large Language Models vs. Human Answers in Controversial Topicscited by 12
- 2024Prompt Obfuscation for Large Language Modelscited by 10
- 2023Automated Evaluation of Personalized Text Generation using Large Language Modelscited by 9
- 2024Can LLMs Deeply Detect Complex Malicious Queries? A Framework for Jailbreaking via Obfuscating Intentcited by 8
- 2024Casper: Prompt Sanitization for Protecting User Privacy in Web-Based Large Language Modelscited by 8
- 2024Can LLMs be Fooled? Investigating Vulnerabilities in LLMscited by 5
- 2024Context-aware Prompt Tuning: Advancing In-Context Learning with Adversarial Methodscited by 4
50 most cited of 52 All 52 (JSON)
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2024Large Language Model Sentinel: LLM Agent for Adversarial Purification
- 2025Attack and defense techniques in large language models: A survey and new perspectives
- 2024Securing Large Language Models: Addressing Bias, Misinformation, and Prompt Attacks
- 2025Data Security in Large Language Models: Risks, Defense, and Directions
- 2024Recent Advances in Attack and Defense Approaches of Large Language Models
- 2025Decoding Latent Attack Surfaces in LLMs: Prompt Injection via HTML in Web Summarization
- 2023Red Teaming Language Model Detectors with Language Models
- 2024Fine-tuned Large Language Models (LLMs): Improved Prompt Injection Attacks Detection