{"list":"other","total":58,"rows":[{"id":"2203.02155","title":"Training language models to follow instructions with human feedback","created":"2022-03-04","cited_by_count":15971},{"id":"2106.09685","title":"LoRA: Low-Rank Adaptation of Large Language Models","created":"2021-06-17","cited_by_count":14380},{"id":"2302.13971","title":"LLaMA: Open and Efficient Foundation Language Models","created":"2023-02-27","cited_by_count":14132},{"id":"2307.09288","title":"Llama 2: Open Foundation and Fine-Tuned Chat Models","created":"2023-07-18","cited_by_count":13028},{"id":"2110.14168","title":"Training Verifiers to Solve Math Word Problems","created":"2021-10-27","cited_by_count":10109},{"id":"2305.18290","title":"Direct Preference Optimization: Your Language Model is Secretly a Reward Model","created":"2023-05-29","cited_by_count":8065},{"id":"2204.05862","title":"Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedback","created":"2022-04-12","cited_by_count":3720},{"id":"2307.15043","title":"Universal and Transferable Adversarial Attacks on Aligned Language Models","created":"2023-07-27","cited_by_count":3104},{"id":"1509.01626","title":"Character-level Convolutional Networks for Text Classification","created":"2015-09-04","cited_by_count":2330},{"id":"2407.10671","title":"Qwen2 Technical Report","created":"2024-07-15","cited_by_count":2120},{"id":"2408.00118","title":"Gemma 2: Improving Open Language Models at a Practical Size","created":"2024-07-31","cited_by_count":1998},{"id":"1711.05101","title":"Decoupled Weight Decay Regularization","created":"2017-11-14","cited_by_count":1831},{"id":"1912.03817","title":"Machine Unlearning","created":"2019-12-09","cited_by_count":1061},{"id":"2307.04657","title":"BeaverTails: Towards Improved Safety Alignment of LLM via a Human-Preference Dataset","created":"2023-07-10","cited_by_count":860},{"id":"2305.14233","title":"Enhancing Chat Language Models by Scaling High-quality Instructional Conversations","created":"2023-05-23","cited_by_count":839},{"id":"2304.06767","title":"RAFT: Reward rAnked FineTuning for Generative Foundation Model Alignment","created":"2023-04-13","cited_by_count":686},{"id":"2310.12773","title":"Safe RLHF: Safe Reinforcement Learning from Human Feedback","created":"2023-10-19","cited_by_count":656},{"id":"2404.05868","title":"Negative Preference Optimization: From Catastrophic Collapse to Effective Unlearning","created":"2024-04-08","cited_by_count":504},{"id":"2304.05302","title":"RRHF: Rank Responses to Align Language Models with Human Feedback without tears","created":"2023-04-11","cited_by_count":463},{"id":"2310.06987","title":"Catastrophic Jailbreak of Open-source LLMs via Exploiting Generation","created":"2023-10-10","cited_by_count":451},{"id":"2210.01504","title":"Knowledge Unlearning for Mitigating Privacy Risks in Language Models","created":"2022-10-04","cited_by_count":437},{"id":"2309.07875","title":"Safety-Tuned LLaMAs: Lessons From Improving the Safety of Large Language Models that Follow Instructions","created":"2023-09-14","cited_by_count":387},{"id":"2310.10683","title":"Large Language Model Unlearning","created":"2023-10-14","cited_by_count":302},{"id":"2310.02949","title":"Shadow Alignment: The Ease of Subverting Safely-Aligned Language Models","created":"2023-10-04","cited_by_count":297},{"id":"2311.05553","title":"Removing RLHF Protections in GPT-4 via Fine-Tuning","created":"2023-11-09","cited_by_count":171},{"id":"2402.02207","title":"Safety Fine-Tuning at (Almost) No Cost: A Baseline for Vision Large Language Models","created":"2024-02-03","cited_by_count":167},{"id":"2402.16835","title":"Eight Methods to Evaluate Robust Unlearning in LLMs","created":"2024-02-26","cited_by_count":163},{"id":"2408.00761","title":"Tamper-Resistant Safeguards for Open-Weight LLMs","created":"2024-08-01","cited_by_count":138},{"id":"2408.17003","title":"Safety Layers in Aligned Large Language Models: The Key to LLM Security","created":"2024-08-30","cited_by_count":134},{"id":"2405.16833","title":"Safe LoRA: the Silver Lining of Reducing Safety Risks when Fine-tuning Large Language Models","created":"2024-05-27","cited_by_count":125},{"id":"2409.18025","title":"An Adversarial Perspective on Machine Unlearning for AI Safety","created":"2024-09-26","cited_by_count":123},{"id":"2402.01109","title":"Vaccine: Perturbation-aware Alignment for Large Language Models against Harmful Fine-tuning Attack","created":"2024-02-02","cited_by_count":115},{"id":"2308.13320","title":"Fine-tuning can cripple your foundation model; preserving features may be the solution","created":"2023-08-25","cited_by_count":96},{"id":"2402.18540","title":"Keeping LLMs Aligned After Fine-tuning: The Crucial Role of Prompt Templates","created":"2024-02-28","cited_by_count":96},{"id":"2409.01586","title":"Booster: Tackling Harmful Fine-tuning for Large Language Models via Attenuating Harmful Perturbation","created":"2024-09-03","cited_by_count":92},{"id":"2403.05030","title":"Defending Against Unforeseen Failure Modes with Latent Adversarial Training","created":"2024-03-08","cited_by_count":88},{"id":"2406.20053","title":"Covert Malicious Finetuning: Challenges in Safeguarding LLM Adaptation","created":"2024-06-28","cited_by_count":80},{"id":"2410.08827","title":"Do Unlearning Methods Remove Information from Language Model Weights?","created":"2024-10-11","cited_by_count":73},{"id":"2410.07471","title":"SEAL: Safety-enhanced Aligned LLM Fine-tuning via Bilevel Data Selection","created":"2024-10-09","cited_by_count":64},{"id":"2211.14946","title":"Self-Destructing Models: Increasing the Costs of Harmful Dual Uses of Foundation Models","created":"2022-11-27","cited_by_count":57},{"id":"2310.00212","title":"Pairwise Proximal Policy Optimization: Harnessing Relative Feedback for LLM Alignment","created":"2023-09-30","cited_by_count":57},{"id":"2410.08109","title":"A Closer Look at Machine Unlearning for Large Language Models","created":"2024-10-10","cited_by_count":56},{"id":"2412.07097","title":"On Evaluating the Durability of Safeguards for Open-Weight LLMs","created":"2024-12-10","cited_by_count":52},{"id":"2407.00106","title":"UnUnlearning: Unlearning is not sufficient for content regulation in advanced generative AI","created":"2024-06-27","cited_by_count":51},{"id":"2501.04952","title":"Open Problems in Machine Unlearning for AI Safety","created":"2025-01-09","cited_by_count":51},{"id":"2407.14981","title":"Open Problems in Technical AI Governance","created":"2024-07-20","cited_by_count":49},{"id":"2407.14937","title":"Operationalizing a Threat Model for Red-Teaming Large Language Models (LLMs)","created":"2024-07-20","cited_by_count":46},{"id":"2410.12777","title":"Meta-Unlearning on Diffusion Models: Preventing Relearning Unlearned Concepts","created":"2024-10-16","cited_by_count":40},{"id":"2412.12497","title":"NLSR: Neuron-Level Safety Realignment of Large Language Models Against Harmful Fine-Tuning","created":"2024-12-17","cited_by_count":37},{"id":"2402.16382","title":"Immunization against harmful fine-tuning attacks","created":"2024-02-26","cited_by_count":35},{"id":"2410.10014","title":"Safety-Aware Fine-Tuning of Large Language Models","created":"2024-10-13","cited_by_count":34},{"id":"2412.14922","title":"RobustFT: Robust Supervised Fine-tuning for Large Language Models under Noisy Response","created":"2024-12-19","cited_by_count":24},{"id":"2407.20224","title":"Can Editing LLMs Inject Harm?","created":"2024-07-29","cited_by_count":22},{"id":"2410.10343","title":"Locking Down the Finetuned LLMs Safety","created":"2024-10-14","cited_by_count":22},{"id":"2405.11227","title":"BadActs: A Universal Backdoor Defense in the Activation Space","created":"2024-05-18","cited_by_count":21},{"id":"2411.08410","title":"The VLLM Safety Paradox: Dual Ease in Jailbreak Attack and Defense","created":"2024-11-13","cited_by_count":21},{"id":"2501.18100","title":"Panacea: Mitigating Harmful Fine-tuning for Large Language Models via Post-fine-tuning Perturbation","created":"2025-01-30","cited_by_count":20},{"id":"2501.06208","title":"Enhancing AI Safety Through the Fusion of Low Rank Adapters","created":"2024-12-30","cited_by_count":4}],"next_cursor":null}