{"list":"other","total":55,"rows":[{"id":"2203.02155","title":"Training language models to follow instructions with human feedback","created":"2022-03-04","cited_by_count":15971},{"id":"2107.03374","title":"Evaluating Large Language Models Trained on Code","created":"2021-07-07","cited_by_count":8320},{"id":"2305.18290","title":"Direct Preference Optimization: Your Language Model is Secretly a Reward Model","created":"2023-05-29","cited_by_count":8065},{"id":"2204.05862","title":"Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedback","created":"2022-04-12","cited_by_count":3720},{"id":"2307.15043","title":"Universal and Transferable Adversarial Attacks on Aligned Language Models","created":"2023-07-27","cited_by_count":3104},{"id":"2212.08073","title":"Constitutional AI: Harmlessness from AI Feedback","created":"2022-12-15","cited_by_count":3050},{"id":"2302.12173","title":"Not what you've signed up for: Compromising Real-World LLM-Integrated Applications with Indirect Prompt Injection","created":"2023-02-23","cited_by_count":1443},{"id":"2312.06674","title":"Llama Guard: LLM-based Input-Output Safeguard for Human-AI Conversations","created":"2023-12-07","cited_by_count":1207},{"id":"2406.11717","title":"Refusal in Language Models Is Mediated by a Single Direction","created":"2024-06-17","cited_by_count":1032},{"id":"1902.10186","title":"Attention is not Explanation","created":"2019-02-26","cited_by_count":929},{"id":"2211.09527","title":"Ignore Previous Prompt: Attack Techniques For Language Models","created":"2022-11-17","cited_by_count":832},{"id":"2404.01318","title":"JailbreakBench: An Open Robustness Benchmark for Jailbreaking Large Language Models","created":"2024-03-28","cited_by_count":536},{"id":"2209.14375","title":"Improving alignment of dialogue agents via targeted human judgements","created":"2022-09-28","cited_by_count":531},{"id":"2404.13208","title":"The Instruction Hierarchy: Training LLMs to Prioritize Privileged Instructions","created":"2024-04-19","cited_by_count":493},{"id":"2404.02151","title":"Jailbreaking Leading Safety-Aligned LLMs with Simple Adaptive Attacks","created":"2024-04-02","cited_by_count":486},{"id":"2310.06987","title":"Catastrophic Jailbreak of Open-source LLMs via Exploiting Generation","created":"2023-10-10","cited_by_count":451},{"id":"1811.07871","title":"Scalable agent alignment via reward modeling: a research direction","created":"2018-11-19","cited_by_count":447},{"id":"2402.06363","title":"StruQ: Defending Against Prompt Injection with Structured Queries","created":"2024-02-09","cited_by_count":375},{"id":"2310.10501","title":"NeMo Guardrails: A Toolkit for Controllable and Safe LLM Applications with Programmable Rails","created":"2023-10-16","cited_by_count":365},{"id":"2310.12815","title":"Formalizing and Benchmarking Prompt Injection Attacks and Defenses","created":"2023-10-19","cited_by_count":364},{"id":"2406.04313","title":"Improving Alignment and Robustness with Circuit Breakers","created":"2024-06-06","cited_by_count":322},{"id":"2402.07867","title":"PoisonedRAG: Knowledge Corruption Attacks to Retrieval-Augmented Generation of Large Language Models","created":"2024-02-12","cited_by_count":267},{"id":"2403.14720","title":"Defending Against Indirect Prompt Injection Attacks With Spotlighting","created":"2024-03-20","cited_by_count":267},{"id":"2112.12870","title":"Measuring Attribution in Natural Language Generation Models","created":"2021-12-23","cited_by_count":256},{"id":"2410.05451","title":"SecAlign: Defending Against Prompt Injection with Preference Optimization","created":"2024-10-07","cited_by_count":210},{"id":"2409.05907","title":"Programming Refusal with Conditional Activation Steering","created":"2024-09-06","cited_by_count":206},{"id":"2501.18837","title":"Constitutional Classifiers: Defending against Universal Jailbreaks across Thousands of Hours of Red Teaming","created":"2025-01-31","cited_by_count":181},{"id":"2403.17710","title":"Optimization-based Prompt Injection Attack to LLM-as-a-Judge","created":"2024-03-26","cited_by_count":143},{"id":"2504.11358","title":"DataSentinel: A Game-Theoretic Detection of Prompt Injection Attacks","created":"2025-04-15","cited_by_count":143},{"id":"2405.06823","title":"PLeak: Prompt Leaking Attacks against Large Language Model Applications","created":"2024-05-10","cited_by_count":127},{"id":"2403.04957","title":"Automatic and Universal Prompt Injection Attacks against Large Language Models","created":"2024-03-07","cited_by_count":119},{"id":"2409.19091","title":"System-Level Defense against Indirect Prompt Injection Attacks: An Information Flow Control Perspective","created":"2024-09-27","cited_by_count":96},{"id":"2402.18649","title":"A New Era in LLM Security: Exploring Security Concerns in Real-World LLM-based Systems","created":"2024-02-28","cited_by_count":77},{"id":"2406.00799","title":"Get my drift? Catching LLM Task Drift with Activation Deltas","created":"2024-06-02","cited_by_count":72},{"id":"2410.09102","title":"Instructional Segment Embedding: Improving LLM Safety with Instruction Hierarchy","created":"2024-10-09","cited_by_count":67},{"id":"2409.20089","title":"Robust LLM safeguarding via refusal feature adversarial training","created":"2024-09-30","cited_by_count":64},{"id":"2502.16580","title":"Can Indirect Prompt Injection Attacks Be Detected and Removed?","created":"2025-02-23","cited_by_count":52},{"id":"2501.15145","title":"PromptShield: Deployable Detection for Prompt Injection Attacks","created":"2025-01-25","cited_by_count":50},{"id":"2406.12934","title":"Current state of LLM Risks and AI Guardrails","created":"2024-06-16","cited_by_count":46},{"id":"2407.05557","title":"$R^2$-Guard: Robust Reasoning Enabled LLM Guardrail via Knowledge-Enhanced Logical Reasoning","created":"2024-07-08","cited_by_count":43},{"id":"2310.03185","title":"Misusing Tools in Large Language Models With Visual Adversarial Examples","created":"2023-10-04","cited_by_count":42},{"id":"2402.00798","title":"Formal-LLM: Integrating Formal Language and Natural Language for Controllable LLM-based Agents","created":"2024-02-01","cited_by_count":40},{"id":"2311.00889","title":"SALLM: Security Assessment of Generated Code","created":"2023-11-01","cited_by_count":39},{"id":"2412.06878","title":"SafeWatch: An Efficient Safety-Policy Following Video Guardrail Model with Transparent Explanations","created":"2024-12-09","cited_by_count":38},{"id":"2505.18333","title":"A Critical Evaluation of Defenses against Prompt Injection Attacks","created":"2025-05-23","cited_by_count":36},{"id":"2510.12252","title":"PromptLocate: Localizing Prompt Injection Attacks","created":"2025-10-14","cited_by_count":28},{"id":"2408.04870","title":"ConfusedPilot: Confused Deputy Risks in RAG-based LLMs","created":"2024-08-09","cited_by_count":22},{"id":"2503.18492","title":"VeriSafe Agent: Safeguarding Mobile GUI Agent via Logic-based Action Verification","created":"2025-03-24","cited_by_count":22},{"id":"2506.00085","title":"COSMIC: Generalized Refusal Direction Identification in LLM Activations","created":"2025-05-30","cited_by_count":19},{"id":"2505.14103","title":"AudioJailbreak: Jailbreak Attacks against End-to-End Large Audio-Language Models","created":"2025-05-20","cited_by_count":18},{"id":"2503.11517","title":"Prompt Injection Detection and Mitigation via AI Multi-Agent NLP Frameworks","created":"2025-03-14","cited_by_count":15},{"id":"2507.13169","title":"Prompt Injection 2.0: Hybrid AI Threats","created":"2025-07-17","cited_by_count":13},{"id":"2504.00018","title":"SandboxEval: Towards Securing Test Environment for Untrusted Code","created":"2025-03-27","cited_by_count":10},{"id":"2312.13435","title":"The Adaptive Arms Race: Redefining Robustness in AI Security","created":"2023-12-20","cited_by_count":5},{"id":"1910.10380","title":"Online Synthesis for Runtime Enforcement of Safety in Multi-Agent Systems","created":"2019-10-23","cited_by_count":3}],"next_cursor":null}