{"list":"other","total":53,"rows":[{"id":"2203.02155","title":"Training language models to follow instructions with human feedback","created":"2022-03-04","cited_by_count":15971},{"id":"1707.06347","title":"Proximal Policy Optimization Algorithms","created":"2017-07-20","cited_by_count":15215},{"id":"2106.09685","title":"LoRA: Low-Rank Adaptation of Large Language Models","created":"2021-06-17","cited_by_count":14380},{"id":"2110.14168","title":"Training Verifiers to Solve Math Word Problems","created":"2021-10-27","cited_by_count":10109},{"id":"2305.18290","title":"Direct Preference Optimization: Your Language Model is Secretly a Reward Model","created":"2023-05-29","cited_by_count":8065},{"id":"2309.06180","title":"Efficient Memory Management for Large Language Model Serving with PagedAttention","created":"2023-09-12","cited_by_count":5944},{"id":"1706.03741","title":"Deep reinforcement learning from human preferences","created":"2017-06-12","cited_by_count":3912},{"id":"2307.02483","title":"Jailbroken: How Does LLM Safety Training Fail?","created":"2023-07-05","cited_by_count":1651},{"id":"2402.04249","title":"HarmBench: A Standardized Evaluation Framework for Automated Red Teaming and Robust Refusal","created":"2024-02-06","cited_by_count":1429},{"id":"2411.15594","title":"A Survey on LLM-as-a-Judge","created":"2024-11-23","cited_by_count":1423},{"id":"2310.03693","title":"Fine-tuning Aligned Language Models Compromises Safety, Even When Users Do Not Intend To!","created":"2023-10-05","cited_by_count":1154},{"id":"2307.04657","title":"BeaverTails: Towards Improved Safety Alignment of LLM via a Human-Preference Dataset","created":"2023-07-10","cited_by_count":860},{"id":"2406.05946","title":"Safety Alignment Should Be Made More Than Just a Few Tokens Deep","created":"2024-06-10","cited_by_count":472},{"id":"2310.06987","title":"Catastrophic Jailbreak of Open-source LLMs via Exploiting Generation","created":"2023-10-10","cited_by_count":451},{"id":"2310.02949","title":"Shadow Alignment: The Ease of Subverting Safely-Aligned Language Models","created":"2023-10-04","cited_by_count":297},{"id":"2406.14598","title":"SORRY-Bench: Systematically Evaluating Large Language Model Safety Refusal","created":"2024-06-20","cited_by_count":240},{"id":"2402.05162","title":"Assessing the Brittleness of Safety Alignment via Pruning and Low-Rank Modifications","created":"2024-02-07","cited_by_count":231},{"id":"2310.20624","title":"LoRA Fine-tuning Efficiently Undoes Safety Training in Llama 2-Chat 70B","created":"2023-10-31","cited_by_count":195},{"id":"2311.05553","title":"Removing RLHF Protections in GPT-4 via Fine-Tuning","created":"2023-11-09","cited_by_count":171},{"id":"2408.00761","title":"Tamper-Resistant Safeguards for Open-Weight LLMs","created":"2024-08-01","cited_by_count":138},{"id":"2503.00555","title":"Safety Tax: Safety Alignment Makes Your Large Reasoning Models Less Reasonable","created":"2025-03-01","cited_by_count":122},{"id":"2404.01099","title":"What is in Your Safe Data? Identifying Benign Data that Breaks Safety","created":"2024-04-01","cited_by_count":118},{"id":"2402.01109","title":"Vaccine: Perturbation-aware Alignment for Large Language Models against Harmful Fine-tuning Attack","created":"2024-02-02","cited_by_count":115},{"id":"2210.10683","title":"Why Should Adversarial Perturbations be Imperceptible? Rethink the Research Paradigm in Adversarial NLP","created":"2022-10-19","cited_by_count":102},{"id":"2308.13320","title":"Fine-tuning can cripple your foundation model; preserving features may be the solution","created":"2023-08-25","cited_by_count":96},{"id":"2405.14577","title":"Representation Noising: A Defence Mechanism Against Harmful Finetuning","created":"2024-05-23","cited_by_count":96},{"id":"2405.18641","title":"Lisa: Lazy Safety Alignment for Large Language Models against Harmful Fine-tuning Attack","created":"2024-05-28","cited_by_count":92},{"id":"2409.01586","title":"Booster: Tackling Harmful Fine-tuning for Large Language Models via Attenuating Harmful Perturbation","created":"2024-09-03","cited_by_count":92},{"id":"2409.18169","title":"Harmful Fine-tuning Attacks and Defenses for Large Language Models: A Survey","created":"2024-09-26","cited_by_count":90},{"id":"2406.20053","title":"Covert Malicious Finetuning: Challenges in Safeguarding LLM Adaptation","created":"2024-06-28","cited_by_count":80},{"id":"2502.05374","title":"Towards LLM Unlearning Resilient to Relearning Attacks: A Sharpness-Aware Minimization Perspective and Beyond","created":"2025-02-07","cited_by_count":79},{"id":"2408.09600","title":"Antidote: Post-fine-tuning Safety Alignment for Large Language Models against Harmful Fine-tuning","created":"2024-08-18","cited_by_count":72},{"id":"2407.10264","title":"What Makes and Breaks Safety Fine-tuning? A Mechanistic Study","created":"2024-07-14","cited_by_count":55},{"id":"2405.17374","title":"Navigating the Safety Landscape: Measuring Risks in Finetuning Large Language Models","created":"2024-05-27","cited_by_count":46},{"id":"2405.19358","title":"Robustifying Safety-Aligned Large Language Models through Clean Data Curation","created":"2024-05-24","cited_by_count":44},{"id":"2502.05209","title":"Model Tampering Attacks Enable More Rigorous Evaluations of LLM Capabilities","created":"2025-02-03","cited_by_count":39},{"id":"2410.09760","title":"Targeted Vaccine: Safety Alignment for Large Language Models against Harmful Fine-Tuning via Layer-wise Perturbation","created":"2024-10-13","cited_by_count":37},{"id":"2406.14673","title":"Insights into LLM Long-Context Failures: When Transformers Know but Don't Tell","created":"2024-06-20","cited_by_count":36},{"id":"2402.16382","title":"Immunization against harmful fine-tuning attacks","created":"2024-02-26","cited_by_count":35},{"id":"2410.18210","title":"Towards Understanding the Fragility of Multilingual LLMs against Fine-Tuning Attacks","created":"2024-10-23","cited_by_count":33},{"id":"2405.16229","title":"No Two Devils Alike: Unveiling Distinct Mechanisms of Fine-tuning Attacks","created":"2024-05-25","cited_by_count":29},{"id":"2501.17433","title":"Virus: Harmful Fine-tuning Attack for Large Language Models Bypassing Guardrail Moderation","created":"2025-01-29","cited_by_count":29},{"id":"2502.01042","title":"SafeSwitch: Steering Unsafe LLM Behavior via Internal Activation Signals","created":"2025-02-03","cited_by_count":29},{"id":"2505.06843","title":"Benign Samples Matter! Fine-tuning On Outlier Benign Samples Severely Breaks Safety","created":"2025-05-11","cited_by_count":22},{"id":"2411.08410","title":"The VLLM Safety Paradox: Dual Ease in Jailbreak Attack and Defense","created":"2024-11-13","cited_by_count":21},{"id":"2510.14005","title":"PIShield: Detecting Prompt Injection Attacks via Intrinsic LLM Features","created":"2025-10-15","cited_by_count":20},{"id":"2406.10630","title":"Emerging Safety Attack and Defense in Federated Instruction Tuning of Large Language Models","created":"2024-06-15","cited_by_count":18},{"id":"2503.20807","title":"Fundamental Safety-Capability Trade-offs in Fine-tuning Large Language Models","created":"2025-03-24","cited_by_count":17},{"id":"2505.16559","title":"CTRAP: Embedding Collapse Trap to Safeguard Large Language Models from Harmful Fine-Tuning","created":"2025-05-22","cited_by_count":11},{"id":"2505.17196","title":"Shape it Up! Restoring LLM Safety during Finetuning","created":"2025-05-22","cited_by_count":11},{"id":"2502.14828","title":"Fundamental Limitations in Pointwise Defences of LLM Finetuning APIs","created":"2025-02-20","cited_by_count":10},{"id":"2411.19335","title":"PEFT-as-an-Attack! Jailbreaking Language Models during Federated Parameter-Efficient Fine-Tuning","created":"2024-11-28","cited_by_count":5},{"id":"2505.04578","title":"Fight Fire with Fire: Defending Against Malicious RL Fine-Tuning via Reward Neutralization","created":"2025-05-07","cited_by_count":3}],"next_cursor":null}