{"total":118,"rows":[{"id":"2406.05946","title":"Safety Alignment Should Be Made More Than Just a Few Tokens Deep","created":"2024-06-10","cited_by_count":472,"area":"alignment"},{"id":"2502.17424","title":"Emergent Misalignment: Narrow finetuning can produce broadly misaligned LLMs","created":"2025-02-24","cited_by_count":172,"area":"safety"},{"id":"2510.18874","title":"Retaining by Doing: The Role of On-Policy Data in Mitigating Forgetting","created":"2025-10-21","cited_by_count":94,"area":null},{"id":"2405.18641","title":"Lisa: Lazy Safety Alignment for Large Language Models against Harmful Fine-tuning Attack","created":"2024-05-28","cited_by_count":92,"area":"alignment"},{"id":"2409.01586","title":"Booster: Tackling Harmful Fine-tuning for Large Language Models via Attenuating Harmful Perturbation","created":"2024-09-03","cited_by_count":92,"area":null},{"id":"2502.12659","title":"The Hidden Risks of Large Reasoning Models: A Safety Assessment of R1","created":"2025-02-18","cited_by_count":91,"area":"lr"},{"id":"2409.18169","title":"Harmful Fine-tuning Attacks and Defenses for Large Language Models: A Survey","created":"2024-09-26","cited_by_count":90,"area":"alignment"},{"id":"2506.19823","title":"Persona Features Control Emergent Misalignment","created":"2025-06-24","cited_by_count":86,"area":null},{"id":"2408.09600","title":"Antidote: Post-fine-tuning Safety Alignment for Large Language Models against Harmful Fine-tuning","created":"2024-08-18","cited_by_count":72,"area":"alignment"},{"id":"2410.08847","title":"Unintentional Unalignment: Likelihood Displacement in Direct Preference Optimization","created":"2024-10-11","cited_by_count":67,"area":"alignment"},{"id":"2506.13206","title":"Thought Crime: Backdoors and Emergent Misalignment in Reasoning Models","created":"2025-06-16","cited_by_count":65,"area":"lr"},{"id":"2410.07471","title":"SEAL: Safety-enhanced Aligned LLM Fine-tuning via Bilevel Data Selection","created":"2024-10-09","cited_by_count":64,"area":null},{"id":"2412.07097","title":"On Evaluating the Durability of Safeguards for Open-Weight LLMs","created":"2024-12-10","cited_by_count":52,"area":null},{"id":"2407.14937","title":"Operationalizing a Threat Model for Red-Teaming Large Language Models (LLMs)","created":"2024-07-20","cited_by_count":46,"area":"safety"},{"id":"2405.19358","title":"Robustifying Safety-Aligned Large Language Models through Clean Data Curation","created":"2024-05-24","cited_by_count":44,"area":"alignment"},{"id":"2504.16980","title":"Safety Pretraining: Toward the Next Generation of Safe AI","created":"2025-04-23","cited_by_count":43,"area":null},{"id":"2406.16306","title":"Cascade Reward Sampling for Efficient Decoding-Time Alignment","created":"2024-06-24","cited_by_count":39,"area":"alignment"},{"id":"2410.09760","title":"Targeted Vaccine: Safety Alignment for Large Language Models against Harmful Fine-Tuning via Layer-wise Perturbation","created":"2024-10-13","cited_by_count":37,"area":"alignment"},{"id":"2412.12497","title":"NLSR: Neuron-Level Safety Realignment of Large Language Models Against Harmful Fine-Tuning","created":"2024-12-17","cited_by_count":37,"area":"alignment"},{"id":"2410.10014","title":"Safety-Aware Fine-Tuning of Large Language Models","created":"2024-10-13","cited_by_count":34,"area":null},{"id":"2410.10148","title":"AlphaDPO: Adaptive Reward Margin for Direct Preference Optimization","created":"2024-10-14","cited_by_count":29,"area":"alignment"},{"id":"2506.13666","title":"We Should Identify and Mitigate Third-Party Safety Risks in MCP-Powered Agent Systems","created":"2025-06-16","cited_by_count":27,"area":"agents"},{"id":"2506.17209","title":"Fine-Tuning Lowers Safety and Disrupts Evaluation Consistency","created":"2025-06-20","cited_by_count":27,"area":"safety"},{"id":"2503.17239","title":"SafeMERGE: Preserving Safety Alignment in Fine-Tuned Large Language Models via Selective Layer-Wise Model Merging","created":"2025-03-21","cited_by_count":25,"area":"alignment"},{"id":"2507.18631","title":"Layer-Aware Representation Filtering: Purifying Finetuning Data to Preserve LLM Safety Alignment","created":"2025-07-24","cited_by_count":24,"area":"alignment"},{"id":"2502.20968","title":"Beware of Your Po! Measuring and Mitigating AI Safety Risks in Role-Play Fine-Tuning of LLMs","created":"2025-02-28","cited_by_count":22,"area":null},{"id":"2505.06843","title":"Benign Samples Matter! Fine-tuning On Outlier Benign Samples Severely Breaks Safety","created":"2025-05-11","cited_by_count":22,"area":"safety"},{"id":"2409.19998","title":"Do Influence Functions Work on Large Language Models?","created":"2024-09-30","cited_by_count":20,"area":null},{"id":"2501.18100","title":"Panacea: Mitigating Harmful Fine-tuning for Large Language Models via Post-fine-tuning Perturbation","created":"2025-01-30","cited_by_count":20,"area":null},{"id":"2502.09673","title":"Are Smarter LLMs Safer? Exploring Safety-Reasoning Trade-offs in Prompting and Fine-Tuning","created":"2025-02-13","cited_by_count":20,"area":"lr"},{"id":"2503.00187","title":"Steering Dialogue Dynamics for Robustness against Multi-turn Jailbreaking Attacks","created":"2025-02-28","cited_by_count":20,"area":"safety"},{"id":"2506.05346","title":"Why LLM Safety Guardrails Collapse After Fine-tuning: A Similarity Analysis Between Alignment and Fine-tuning Datasets","created":"2025-06-05","cited_by_count":20,"area":"alignment"},{"id":"2511.05408","title":"Steering Language Models with Weight Arithmetic","created":"2025-11-07","cited_by_count":20,"area":null},{"id":"2511.06626","title":"Spilling the Beans: Teaching LLMs to Self-Report Their Hidden Objectives","created":"2025-11-10","cited_by_count":15,"area":"agents"},{"id":"2508.12531","title":"Rethinking Safety in LLM Fine-tuning: An Optimization Perspective","created":"2025-08-17","cited_by_count":14,"area":"lr"},{"id":"2505.19056","title":"An Embarrassingly Simple Defense Against LLM Abliteration Attacks","created":"2025-05-25","cited_by_count":13,"area":"safety"},{"id":"2506.15606","title":"LoX: Low-Rank Extrapolation Robustifies LLM Safety Against Fine-tuning","created":"2025-06-18","cited_by_count":12,"area":"safety"},{"id":"2510.20956","title":"Self-Jailbreaking: Language Models Can Reason Themselves Out of Safety Alignment After Benign Reasoning Training","created":"2025-10-23","cited_by_count":12,"area":"lr"},{"id":"2510.27172","title":"Adaptive Defense against Harmful Fine-Tuning for Large Language Models via Bayesian Data Scheduler","created":"2025-10-31","cited_by_count":12,"area":null},{"id":"2406.16746","title":"The Responsible Foundation Model Development Cheatsheet: A Review of Tools & Resources","created":"2024-06-24","cited_by_count":11,"area":null},{"id":"2501.19180","title":"Enhancing Model Defense Against Jailbreaks with Proactive Safety Reasoning","created":"2025-01-31","cited_by_count":11,"area":"lr"},{"id":"2505.16559","title":"CTRAP: Embedding Collapse Trap to Safeguard Large Language Models from Harmful Fine-Tuning","created":"2025-05-22","cited_by_count":11,"area":"safety"},{"id":"2505.17196","title":"Shape it Up! Restoring LLM Safety during Finetuning","created":"2025-05-22","cited_by_count":11,"area":"alignment"},{"id":"2508.07172","title":"Gradient Surgery for Safe LLM Fine-Tuning","created":"2025-08-10","cited_by_count":11,"area":"alignment"},{"id":"2508.17158","title":"Towards Safeguarding LLM Fine-tuning APIs against Cipher Attacks","created":"2025-08-23","cited_by_count":11,"area":null},{"id":"2405.11647","title":"Hummer: Towards Limited Competitive Preference Dataset","created":"2024-05-19","cited_by_count":10,"area":"alignment"},{"id":"2409.17357","title":"Revisiting inverse Hessian vector products for calculating influence functions","created":"2024-09-25","cited_by_count":10,"area":null},{"id":"2502.14828","title":"Fundamental Limitations in Pointwise Defences of LLM Finetuning APIs","created":"2025-02-20","cited_by_count":10,"area":null},{"id":"2505.12186","title":"Self-Destructive Language Model","created":"2025-05-18","cited_by_count":10,"area":"safety"},{"id":"2506.05451","title":"Interpretation Meets Safety: A Survey on Interpretation Methods and Tools for Improving LLM Safety","created":"2025-06-05","cited_by_count":10,"area":"safety"},{"id":"2510.02833","title":"Attack via Overfitting: 10-shot Benign Fine-tuning to Jailbreak LLMs","created":"2025-10-03","cited_by_count":10,"area":"alignment"},{"id":"2512.10150","title":"Unforgotten Safety: Preserving Safety Alignment of Large Language Models with Continual Learning","created":"2025-12-10","cited_by_count":10,"area":"alignment"},{"id":"2410.07589","title":"No Free Lunch: Retrieval-Augmented Generation Undermines Fairness in LLMs, Even for Vigilant Users","created":"2024-10-10","cited_by_count":9,"area":"rag"},{"id":"2502.11411","title":"Detecting and Filtering Unsafe Training Data via Data Attribution with Denoised Representation","created":"2025-02-17","cited_by_count":9,"area":null},{"id":"2507.11630","title":"Jailbreak-Tuning: Models Efficiently Learn Jailbreak Susceptibility","created":"2025-07-15","cited_by_count":9,"area":"safety"},{"id":"2508.14031","title":"Unintended Misalignment from Agentic Fine-Tuning: Risks and Mitigation","created":"2025-08-19","cited_by_count":9,"area":"agents"},{"id":"2406.16743","title":"Safety Alignment of Large Language Models via Contrasting Safe and Harmful Distributions","created":"2024-06-24","cited_by_count":8,"area":"alignment"},{"id":"2602.04735","title":"From Data to Behavior: Predicting Unintended Model Behaviors Before Training","created":"2026-02-04","cited_by_count":8,"area":null},{"id":"2602.06258","title":"GRP-Obliteration: Unaligning LLMs With a Single Unlabeled Prompt","created":"2026-02-05","cited_by_count":7,"area":"alignment"},{"id":"2505.14185","title":"Safety Subspaces are Not Linearly Distinct: A Fine-Tuning Case Study","created":"2025-05-20","cited_by_count":6,"area":"alignment"},{"id":"2506.07452","title":"When Style Breaks Safety: Defending LLMs Against Superficial Style Alignment","created":"2025-06-09","cited_by_count":6,"area":"safety"},{"id":"2506.12913","title":"Jailbreak Transferability Emerges from Shared Representations","created":"2025-06-15","cited_by_count":6,"area":"safety"},{"id":"2506.14913","title":"Winter Soldier: Backdooring Language Models at Pre-Training with Indirect Data Poisoning","created":"2025-06-17","cited_by_count":6,"area":"safety"},{"id":"2601.15220","title":"Privacy Collapse: Benign Fine-Tuning Can Break Contextual Privacy in Language Models","created":"2026-01-21","cited_by_count":6,"area":null},{"id":"2404.16020","title":"Investigating Adversarial Trigger Transfer in Large Language Models","created":"2024-04-24","cited_by_count":5,"area":"alignment"},{"id":"2411.19335","title":"PEFT-as-an-Attack! Jailbreaking Language Models during Federated Parameter-Efficient Fine-Tuning","created":"2024-11-28","cited_by_count":5,"area":"safety"},{"id":"2503.03039","title":"LLM Misalignment via Adversarial RLHF Platforms","created":"2025-03-04","cited_by_count":5,"area":"alignment"},{"id":"2504.02193","title":"More is Less: The Pitfalls of Multi-Model Synthetic Preference Data in DPO Safety Alignment","created":"2025-04-03","cited_by_count":5,"area":"alignment"},{"id":"2505.16789","title":"Accidental Vulnerability: Factors in Fine-Tuning that Shift Model Safeguards","created":"2025-05-22","cited_by_count":5,"area":null},{"id":"2505.23724","title":"SC-LoRA: Balancing Efficient Fine-tuning and Knowledge Preservation via Subspace-Constrained LoRA","created":"2025-05-29","cited_by_count":5,"area":null},{"id":"2507.09424","title":"DATE-LM: Benchmarking Data Attribution Evaluation for Large Language Models","created":"2025-07-12","cited_by_count":5,"area":null},{"id":"2601.23081","title":"Character as a Latent Variable in Large Language Models: A Mechanistic Account of Emergent Misalignment and Conditional Safety Failures","created":"2026-01-30","cited_by_count":5,"area":"safety"},{"id":"2510.19152","title":"Subliminal Corruption: Mechanisms, Thresholds, and Interpretability","created":"2025-10-22","cited_by_count":4,"area":null},{"id":"2602.05228","title":"Surgery: Mitigating Harmful Fine-Tuning for Large Language Models via Attention Sink","created":"2026-02-05","cited_by_count":4,"area":"alignment"},{"id":"2602.11157","title":"Response-Based Knowledge Distillation for Multilingual Jailbreak Prevention Unwittingly Compromises Safety","created":"2025-12-08","cited_by_count":4,"area":"alignment"},{"id":"2603.01185","title":"Token-level Data Selection for Safe LLM Fine-tuning","created":"2026-03-01","cited_by_count":3,"area":null},{"id":"2506.07356","title":"Safety-Aligned Weights Are Not Enough: Refusal-Teacher-Guided Finetuning Enhances Safety and Downstream Performance under Harmful Finetuning Attacks","created":"2025-06-09","cited_by_count":2,"area":"safety"},{"id":"2510.01342","title":"Fine-Tuning Jailbreaks under Highly Constrained Black-Box Settings: A Three-Pronged Approach","created":"2025-10-01","cited_by_count":2,"area":"safety"},{"id":"2602.06911","title":"TamperBench: Systematically Stress-Testing LLM Safety Under Fine-Tuning and Tampering","created":"2026-02-06","cited_by_count":2,"area":"safety"},{"id":"2603.08104","title":"Invisible Safety Threat: Malicious Finetuning for LLM via Steganography","created":"2026-03-09","cited_by_count":2,"area":"alignment"},{"id":"2605.06901","title":"Reflections and New Directions for Human-Centered Large Language Models","created":"2026-05-07","cited_by_count":2,"area":null},{"id":"2605.18309","title":"Alignment Dynamics in LLM Fine-Tuning","created":"2026-05-18","cited_by_count":2,"area":"alignment"},{"id":"2511.19009","title":"Understanding and Mitigating Over-refusal for Large Language Models via Representation Intervention","created":"2025-11-24","cited_by_count":1,"area":"safety"},{"id":"2601.12460","title":"TrojanPraise: Jailbreak LLMs via Benign Fine-Tuning","created":"2026-01-18","cited_by_count":1,"area":"safety"},{"id":"2601.12639","title":"Objective Matters: Fine-Tuning Objectives Shape Safety, Robustness, and Persona Drift","created":"2026-01-19","cited_by_count":1,"area":"alignment"},{"id":"2601.13981","title":"VirtualCrime: Evaluating the Criminal Potential and Agentic Behaviors of Large Language Models via Sandbox Simulation","created":"2026-01-20","cited_by_count":1,"area":"agents"},{"id":"2603.02229","title":"Safety Training May Persist Through Helpfulness Optimization in LLM Agents","created":"2026-02-13","cited_by_count":1,"area":"agents"},{"id":"2603.24857","title":"AI Security in the Foundation Model Era: A Comprehensive Survey from a Unified Perspective","created":"2026-03-25","cited_by_count":1,"area":"safety"},{"id":"2604.16659","title":"Benign Fine-Tuning Breaks Safety Alignment in Audio LLMs","created":"2026-04-17","cited_by_count":1,"area":"alignment"},{"id":"2605.00445","title":"The Power of Order: Fooling LLMs with Adversarial Table Permutations","created":"2026-05-01","cited_by_count":1,"area":null},{"id":"2606.00160","title":"DataShield: Safety-degrading Data Filtering for LLM Benign Instruction Fine-Tuning","created":"2026-05-29","cited_by_count":1,"area":null},{"id":"2606.19168","title":"Beyond Safe Data: Pretraining-Stage Alignment with Regular Safety Reflection","created":"2026-06-17","cited_by_count":1,"area":"alignment"},{"id":"2607.22676","title":"How LLM Task-Adaptation Reshapes Alignment: A Multi-dimensional Study of Behavioral and Representational Drift","created":"2026-07-10","cited_by_count":1,"area":null},{"id":"2608.13482","title":"Synthetic Persona Pretraining: Alignment from Token Zero","created":"2026-08-13","cited_by_count":1,"area":null},{"id":"2609.01091","title":"Subliminal Learning as Trait-Direction Drift: A Mechanism and Targeted Control under SFT Distillation","created":"2026-09-01","cited_by_count":1,"area":"distill"},{"id":"2609.19589","title":"Form Over Content In Gradient-Based Data Attribution Methods","created":"2026-09-17","cited_by_count":1,"area":null},{"id":"2504.21042","title":"What's Pulling the Strings? Evaluating Integrity and Attribution in AI Training and Inference through Concept Shift","created":"2025-04-28","cited_by_count":0,"area":"safety"},{"id":"2505.17066","title":"Improving LLM Outputs Against Jailbreak Attacks with Expert Model Integration","created":"2025-05-18","cited_by_count":0,"area":"safety"},{"id":"2506.00062","title":"SafeCOMM: A Study on Safety Degradation in Fine-Tuned Telecom Large Language Models","created":"2025-05-29","cited_by_count":0,"area":"safety"},{"id":"2602.02258","title":"Alignment-Aware Model Adaptation via Feedback-Guided Optimization","created":"2026-02-02","cited_by_count":0,"area":null}],"next_cursor":"100"}