{"total":104,"rows":[{"id":"2203.02155","title":"Training language models to follow instructions with human feedback","created":"2022-03-04","cited_by_count":15971,"area":"alignment"},{"id":"2310.03693","title":"Fine-tuning Aligned Language Models Compromises Safety, Even When Users Do Not Intend To!","created":"2023-10-05","cited_by_count":1154,"area":"alignment"},{"id":"2305.14387","title":"AlpacaFarm: A Simulation Framework for Methods that Learn from Human Feedback","created":"2023-05-22","cited_by_count":748,"area":"alignment"},{"id":"2209.07858","title":"Red Teaming Language Models to Reduce Harms: Methods, Scaling Behaviors, and Lessons Learned","created":"2022-08-23","cited_by_count":729,"area":"alignment"},{"id":"2308.06463","title":"GPT-4 Is Too Smart To Be Safe: Stealthy Chat with LLMs via Cipher","created":"2023-08-12","cited_by_count":423,"area":"alignment"},{"id":"2201.03544","title":"The Effects of Reward Misspecification: Mapping and Mitigating Misaligned Models","created":"2022-01-10","cited_by_count":328,"area":"alignment"},{"id":"2310.02949","title":"Shadow Alignment: The Ease of Subverting Safely-Aligned Language Models","created":"2023-10-04","cited_by_count":297,"area":"alignment"},{"id":"2306.04488","title":"Rewarded soups: towards Pareto-optimal alignment by interpolating weights fine-tuned on diverse rewards","created":"2023-06-07","cited_by_count":243,"area":"alignment"},{"id":"2307.04964","title":"Secrets of RLHF in Large Language Models Part I: PPO","created":"2023-07-11","cited_by_count":229,"area":"alignment"},{"id":"2307.16039","title":"Okapi: Instruction-tuned Large Language Models in Multiple Languages with Reinforcement Learning from Human Feedback","created":"2023-07-29","cited_by_count":190,"area":"alignment"},{"id":"2310.10505","title":"ReMax: A Simple, Effective, and Efficient Reinforcement Learning Method for Aligning Large Language Models","created":"2023-10-16","cited_by_count":187,"area":"alignment"},{"id":"2401.12187","title":"WARM: On the Benefits of Weight Averaged Reward Models","created":"2024-01-22","cited_by_count":147,"area":"alignment"},{"id":"2401.04056","title":"A Minimaximalist Approach to Reinforcement Learning from Human Feedback","created":"2024-01-08","cited_by_count":144,"area":"alignment"},{"id":"2406.10216","title":"Regularizing Hidden States Enables Learning Generalizable Reward Model for LLMs","created":"2024-06-14","cited_by_count":142,"area":"alignment"},{"id":"2310.04373","title":"Confronting Reward Model Overoptimization with Constrained RLHF","created":"2023-10-06","cited_by_count":96,"area":"alignment"},{"id":"2305.16960","title":"Training Socially Aligned Language Models on Simulated Social Interactions","created":"2023-05-26","cited_by_count":78,"area":"alignment"},{"id":"2402.06627","title":"Feedback Loops With Language Models Drive In-Context Reward Hacking","created":"2024-02-09","cited_by_count":77,"area":"alignment"},{"id":"2209.00731","title":"In conversation with Artificial Intelligence: aligning language models with human values","created":"2022-09-01","cited_by_count":62,"area":"alignment"},{"id":"2302.05206","title":"The Wisdom of Hindsight Makes Language Models Better Instruction Followers","created":"2023-02-10","cited_by_count":62,"area":"alignment"},{"id":"2305.00955","title":"Bridging the Gap: A Survey on Integrating (Human) Feedback for Natural Language Generation","created":"2023-05-01","cited_by_count":55,"area":"alignment"},{"id":"2406.08469","title":"PAL: Pluralistic Alignment Framework for Learning from Heterogeneous Preferences","created":"2024-06-12","cited_by_count":54,"area":"alignment"},{"id":"2407.02273","title":"Language Model Alignment in Multilingual Trolley Problems","created":"2024-07-02","cited_by_count":46,"area":"alignment"},{"id":"2308.12014","title":"From Instructions to Intrinsic Human Values -- A Survey of Alignment Goals for Big Models","created":"2023-08-23","cited_by_count":45,"area":"alignment"},{"id":"2406.16768","title":"WARP: On the Benefits of Weight Averaged Rewarded Policies","created":"2024-06-24","cited_by_count":45,"area":"alignment"},{"id":"2310.19677","title":"MoCa: Measuring Human-Language Model Alignment on Causal and Moral Judgment Tasks","created":"2023-10-30","cited_by_count":44,"area":"alignment"},{"id":"2403.17141","title":"MetaAligner: Towards Generalizable Multi-Objective Alignment of Language Models","created":"2024-03-25","cited_by_count":44,"area":"alignment"},{"id":"2203.07472","title":"Uncertainty Estimation for Language Reward Models","created":"2022-03-14","cited_by_count":37,"area":"alignment"},{"id":"2311.06899","title":"Flames: Benchmarking Value Alignment of LLMs in Chinese","created":"2023-11-12","cited_by_count":37,"area":"alignment"},{"id":"2405.13967","title":"Model Editing as a Robust and Denoised variant of DPO: A Case Study on Toxicity","created":"2024-05-22","cited_by_count":35,"area":"alignment"},{"id":"2309.11166","title":"Are Large Language Models Really Robust to Word-Level Perturbations?","created":"2023-09-20","cited_by_count":32,"area":"alignment"},{"id":"2505.17147","title":"MTSA: Multi-turn Safety Alignment for LLMs through Multi-round Red-teaming","created":"2025-05-22","cited_by_count":32,"area":"alignment"},{"id":"2307.16851","title":"Towards Trustworthy and Aligned Machine Learning: A Data-centric Survey with Causality Perspectives","created":"2023-07-31","cited_by_count":30,"area":"alignment"},{"id":"2505.03156","title":"Soft Best-of-n Sampling for Model Alignment","created":"2025-05-06","cited_by_count":30,"area":"alignment"},{"id":"2402.09764","title":"Aligning Crowd Feedback via Distributional Preference Reward Modeling","created":"2024-02-15","cited_by_count":28,"area":"alignment"},{"id":"2412.00967","title":"Linear Probe Penalties Reduce LLM Sycophancy","created":"2024-12-01","cited_by_count":28,"area":"alignment"},{"id":"2310.11971","title":"Improving Generalization of Alignment with Human Preferences through Group Invariant Learning","created":"2023-10-18","cited_by_count":25,"area":"alignment"},{"id":"2404.00934","title":"ChatGLM-RLHF: Practices of Aligning Large Language Models with Human Feedback","created":"2024-04-01","cited_by_count":25,"area":"alignment"},{"id":"2406.11191","title":"A Survey on Human Preference Learning for Large Language Models","created":"2024-06-17","cited_by_count":24,"area":"alignment"},{"id":"2407.14916","title":"Improving Context-Aware Preference Modeling for Language Models","created":"2024-07-20","cited_by_count":22,"area":"alignment"},{"id":"2403.04204","title":"On the Essence and Prospect: An Investigation of Alignment Approaches for Big Models","created":"2024-03-07","cited_by_count":21,"area":"alignment"},{"id":"2405.08154","title":"LLM Theory of Mind and Alignment: Opportunities and Risks","created":"2024-05-13","cited_by_count":18,"area":"alignment"},{"id":"2303.13512","title":"Towards Solving Fuzzy Tasks with Human Feedback: A Retrospective of the MineRL BASALT 2022 Competition","created":"2023-03-23","cited_by_count":15,"area":"alignment"},{"id":"2403.19279","title":"Fine-Tuning Language Models with Reward Learning on Policy","created":"2024-03-28","cited_by_count":15,"area":"alignment"},{"id":"2502.04322","title":"Speak Easy: Eliciting Harmful Jailbreaks from LLMs with Simple Interactions","created":"2025-02-06","cited_by_count":15,"area":"alignment"},{"id":"2505.02666","title":"A Survey on Progress in LLM Alignment from the Perspective of Reward Design","created":"2025-05-05","cited_by_count":15,"area":"alignment"},{"id":"2507.19672","title":"Alignment and Safety in Large Language Models: Safety Mechanisms, Training Paradigms, and Emerging Challenges","created":"2025-07-25","cited_by_count":15,"area":"alignment"},{"id":"2310.19080","title":"Reward Finetuning for Faster and More Accurate Unsupervised Object Discovery","created":"2023-10-29","cited_by_count":14,"area":"alignment"},{"id":"2405.16661","title":"RLSF: Fine-tuning LLMs via Symbolic Feedback","created":"2024-05-26","cited_by_count":14,"area":"alignment"},{"id":"2406.10977","title":"Toward Optimal LLM Alignments Using Two-Player Games","created":"2024-06-16","cited_by_count":13,"area":"alignment"},{"id":"2509.01418","title":"On the Alignment of Large Language Models with Global Human Opinion","created":"2025-09-01","cited_by_count":13,"area":"alignment"},{"id":"2403.03419","title":"Negating Negatives: Alignment with Human Negative Samples via Distributional Dispreference Optimization","created":"2024-03-06","cited_by_count":11,"area":"alignment"},{"id":"2406.14393","title":"Jailbreaking as a Reward Misspecification Problem","created":"2024-06-20","cited_by_count":11,"area":"alignment"},{"id":"2412.15623","title":"JailPO: A Novel Black-box Jailbreak Framework via Preference Optimization against Aligned LLMs","created":"2024-12-20","cited_by_count":11,"area":"alignment"},{"id":"2310.12103","title":"Quality Diversity through Human Feedback: Towards Open-Ended Diversity-Driven Optimization","created":"2023-10-18","cited_by_count":10,"area":"alignment"},{"id":"2406.07295","title":"Multi-objective Reinforcement learning from AI Feedback","created":"2024-06-11","cited_by_count":10,"area":"alignment"},{"id":"2506.06964","title":"Offline RL by Reward-Weighted Fine-Tuning for Conversation Optimization","created":"2025-06-08","cited_by_count":10,"area":"alignment"},{"id":"2305.06176","title":"Fine-tuning Language Models with Generative Adversarial Reward Modelling","created":"2023-05-09","cited_by_count":8,"area":"alignment"},{"id":"2405.11870","title":"Intuitive Fine-Tuning: Towards Simplifying Alignment into a Single Process","created":"2024-05-20","cited_by_count":8,"area":"alignment"},{"id":"2410.03818","title":"Large Language Models can be Strong Self-Detoxifiers","created":"2024-10-04","cited_by_count":7,"area":"alignment"},{"id":"2309.02884","title":"Aligning Large Language Models for Clinical Tasks","created":"2023-09-06","cited_by_count":6,"area":"alignment"},{"id":"2410.12491","title":"Insights from the Inverse: Reconstructing LLM Training Goals Through Inverse Reinforcement Learning","created":"2024-10-16","cited_by_count":6,"area":"alignment"},{"id":"2406.10030","title":"Off-Policy Evaluation from Logged Human Feedback","created":"2024-06-14","cited_by_count":5,"area":"alignment"},{"id":"2308.06385","title":"ZYN: Zero-Shot Reward Models with Yes-No Questions for RLAIF","created":"2023-08-11","cited_by_count":4,"area":"alignment"},{"id":"2406.03642","title":"Is Free Self-Alignment Possible?","created":"2024-06-05","cited_by_count":4,"area":"alignment"},{"id":"2409.19024","title":"Elephant in the Room: Unveiling the Impact of Reward Model Quality in Alignment","created":"2024-09-26","cited_by_count":4,"area":"alignment"},{"id":"2411.01798","title":"SALSA: Soup-based Alignment Learning for Stronger Adaptation in RLHF","created":"2024-11-04","cited_by_count":4,"area":"alignment"},{"id":"2502.14187","title":"Federated Fine-Tuning of Large Language Models: Kahneman-Tversky vs. Direct Preference Optimization","created":"2025-02-20","cited_by_count":4,"area":"alignment"},{"id":"2604.12359","title":"Compiling Activation Steering into Weights via Null-Space Constraints for Stealthy Backdoors","created":"2026-04-14","cited_by_count":4,"area":"alignment"},{"id":"2406.11039","title":"Dynamic Normativity: Necessary and Sufficient Conditions for Value Alignment","created":"2024-06-16","cited_by_count":3,"area":"alignment"},{"id":"2502.08657","title":"Refining Positive and Toxic Samples for Dual Safety Self-Alignment of LLMs with Minimal Human Interventions","created":"2025-02-08","cited_by_count":3,"area":"alignment"},{"id":"2504.10002","title":"FLoRA: Sample-Efficient Preference-based RL via Low-Rank Style Adaptation of Reward Functions","created":"2025-04-14","cited_by_count":3,"area":"alignment"},{"id":"2507.16679","title":"PICACO: Pluralistic In-Context Value Alignment of LLMs via Total Correlation Optimization","created":"2025-07-22","cited_by_count":3,"area":"alignment"},{"id":"2508.08550","title":"Fine-grained Video Dubbing Duration Alignment with Segment Supervised Preference Optimization","created":"2025-08-12","cited_by_count":3,"area":"alignment"},{"id":"2508.16982","title":"Decoding Alignment: A Critical Survey of LLM Development Initiatives through Value-setting and Data-centric Lens","created":"2025-08-23","cited_by_count":3,"area":"alignment"},{"id":"2607.25614","title":"MemSFT: Mitigating Alignment Tax with an External Parametric Memory","created":"2026-07-28","cited_by_count":3,"area":"alignment"},{"id":"2406.06587","title":"TouchAI: Exploring human-AI perceptual alignment in touch through language model representations","created":"2024-06-05","cited_by_count":2,"area":"alignment"},{"id":"2408.07663","title":"Alignment-Enhanced Decoding:Defending via Token-Level Adaptive Refining of Probability Distributions","created":"2024-08-14","cited_by_count":2,"area":"alignment"},{"id":"2508.01930","title":"Word Overuse and Alignment in Large Language Models: The Influence of Learning from Human Feedback","created":"2025-08-03","cited_by_count":2,"area":"alignment"},{"id":"2510.06096","title":"The Alignment Auditor: A Bayesian Framework for Verifying and Refining LLM Objectives","created":"2025-10-07","cited_by_count":2,"area":"alignment"},{"id":"2603.12681","title":"Colluding LoRA: A Compositional Vulnerability in LLM Safety Alignment","created":"2026-03-13","cited_by_count":2,"area":"alignment"},{"id":"2606.04284","title":"Sparse Mixture-of-Experts Reward Models Learn Interpretable and Specialized Experts for Personalized Preference Modeling","created":"2026-06-02","cited_by_count":2,"area":"alignment"},{"id":"2406.16377","title":"On the Transformations across Reward Model, Parameter Update, and In-Context Prompt","created":"2024-06-24","cited_by_count":1,"area":"alignment"},{"id":"2411.04127","title":"Combining Theory of Mind and Kindness for Self-Supervised Human-AI Alignment","created":"2024-10-21","cited_by_count":1,"area":"alignment"},{"id":"2507.14202","title":"PRM-Free Security Alignment of Large Models via Red Teaming and Adversarial Training","created":"2025-07-14","cited_by_count":1,"area":"alignment"},{"id":"2510.06092","title":"Learning from Failures: Understanding LLM Alignment through Failure-Aware Inverse RL","created":"2025-10-07","cited_by_count":1,"area":"alignment"},{"id":"2510.10077","title":"A-IPO: Adaptive Intent-driven Preference Optimization","created":"2025-10-11","cited_by_count":1,"area":"alignment"},{"id":"2511.21737","title":"Polarity-Aware Probing for Quantifying Latent Alignment in Language Models","created":"2025-11-21","cited_by_count":1,"area":"alignment"},{"id":"2602.01068","title":"From Utterance to Vividity: Training Expressive Subtitle Translation LLM via Adaptive Local Preference Optimization","created":"2026-02-01","cited_by_count":1,"area":"alignment"},{"id":"2604.17769","title":"Reverse Constitutional AI: A Framework for Controllable Toxic Data Generation via Probability-Clamped RLAIF","created":"2026-04-20","cited_by_count":1,"area":"alignment"},{"id":"2605.17413","title":"Ablating Safety: Mechanisms for Removing Alignment in Language Models for Security Applications","created":"2026-05-17","cited_by_count":1,"area":"alignment"},{"id":"2506.09329","title":"Towards Efficient and Effective Alignment of Large Language Models","created":"2025-06-11","cited_by_count":0,"area":"alignment"},{"id":"2507.05660","title":"Optimus: A Robust Defense Framework for Mitigating Toxicity while Fine-Tuning Conversational AI","created":"2025-07-08","cited_by_count":0,"area":"alignment"},{"id":"2508.02063","title":"TRACEALIGN -- Tracing the Drift: Attributing Alignment Failures to Training-Time Belief Sources in LLMs","created":"2025-08-04","cited_by_count":0,"area":"alignment"},{"id":"2509.00091","title":"Ensemble Debates with Local Large Language Models for AI Alignment","created":"2025-08-27","cited_by_count":0,"area":"alignment"},{"id":"2509.07642","title":"Getting In Contract with Large Language Models -- An Agency Theory Perspective On Large Language Model Alignment","created":"2025-09-09","cited_by_count":0,"area":"alignment"},{"id":"2601.17096","title":"Beyond Instrumental and Substitutive Paradigms: Introducing Machine Culture as an Emergent Phenomenon in Large Language Models","created":"2026-01-23","cited_by_count":0,"area":"alignment"},{"id":"2604.17210","title":"Guardrails in Logit Space: Safety Token Regularization for LLM Alignment","created":"2026-04-19","cited_by_count":0,"area":"alignment"},{"id":"2606.01755","title":"TriAlign: Towards Universal Truth Consistency in Personalized LLM Alignment","created":"2026-06-01","cited_by_count":0,"area":"alignment"},{"id":"2606.06037","title":"SpeechJBB: Probing Safety Alignment and Comprehension in Large Audio Language Models under Code-Switched Speech","created":"2026-06-04","cited_by_count":0,"area":"alignment"},{"id":"2608.09551","title":"Pragmatic Attack Surface: Vulnerabilities of Implicit Context in Large Language Models","created":"2026-08-10","cited_by_count":0,"area":"alignment"}],"next_cursor":"100"}