{"total":121,"rows":[{"id":"2009.01325","title":"Learning to summarize from human feedback","created":"2020-09-02","cited_by_count":2588,"area":"alignment"},{"id":"2305.11206","title":"LIMA: Less Is More for Alignment","created":"2023-05-18","cited_by_count":1100,"area":"alignment"},{"id":"2405.14734","title":"SimPO: Simple Preference Optimization with a Reference-Free Reward","created":"2024-05-23","cited_by_count":963,"area":"alignment"},{"id":"2212.09251","title":"Discovering Language Model Behaviors with Model-Written Evaluations","created":"2022-12-19","cited_by_count":836,"area":"alignment"},{"id":"2304.05302","title":"RRHF: Rank Responses to Align Language Models with Human Feedback without tears","created":"2023-04-11","cited_by_count":463,"area":"alignment"},{"id":"2305.03047","title":"Principle-Driven Self-Alignment of Language Models from Scratch with Minimal Human Supervision","created":"2023-05-04","cited_by_count":318,"area":"alignment"},{"id":"2310.03716","title":"A Long Way to Go: Investigating Length Correlations in RLHF","created":"2023-10-05","cited_by_count":291,"area":"alignment"},{"id":"2302.08582","title":"Pretraining Language Models with Human Preferences","created":"2023-02-16","cited_by_count":247,"area":"alignment"},{"id":"2307.04964","title":"Secrets of RLHF in Large Language Models Part I: PPO","created":"2023-07-11","cited_by_count":229,"area":"alignment"},{"id":"2211.15006","title":"Fine-tuning language models to find agreement among humans with diverse preferences","created":"2022-11-28","cited_by_count":189,"area":"alignment"},{"id":"2309.16240","title":"Beyond Reverse KL: Generalizing Direct Preference Optimization with Diverse Divergence Constraints","created":"2023-09-28","cited_by_count":174,"area":"alignment"},{"id":"2401.06080","title":"Secrets of RLHF in Large Language Models Part II: Reward Modeling","created":"2024-01-11","cited_by_count":171,"area":"alignment"},{"id":"2405.17220","title":"RLAIF-V: Open-Source AI Feedback Leads to Super GPT-4V Trustworthiness","created":"2024-05-27","cited_by_count":131,"area":"alignment"},{"id":"2303.16755","title":"Training Language Models with Language Feedback at Scale","created":"2023-03-28","cited_by_count":128,"area":"alignment"},{"id":"2507.18624","title":"Checklists Are Better Than Reward Models For Aligning Language Models","created":"2025-07-24","cited_by_count":128,"area":"alignment"},{"id":"2312.16682","title":"Some things are more CRINGE than others: Iterative Preference Optimization with the Pairwise Cringe Loss","created":"2023-12-27","cited_by_count":108,"area":"alignment"},{"id":"2402.01694","title":"ARGS: Alignment as Reward-Guided Search","created":"2024-01-23","cited_by_count":103,"area":"alignment"},{"id":"2407.10490","title":"Learning Dynamics of LLM Finetuning","created":"2024-07-15","cited_by_count":95,"area":"alignment"},{"id":"2404.17546","title":"Probabilistic Inference in Language Models via Twisted Sequential Monte Carlo","created":"2024-04-26","cited_by_count":90,"area":"alignment"},{"id":"2305.13735","title":"Aligning Large Language Models through Synthetic Feedback","created":"2023-05-23","cited_by_count":75,"area":"alignment"},{"id":"2405.16455","title":"On the Algorithmic Bias of Aligning Large Language Models with RLHF: Preference Collapse and Matching Regularization","created":"2024-05-26","cited_by_count":72,"area":"alignment"},{"id":"2402.06147","title":"DeAL: Decoding-time Alignment for Large Language Models","created":"2024-02-05","cited_by_count":55,"area":"alignment"},{"id":"2204.14146","title":"Training Language Models with Language Feedback","created":"2022-04-29","cited_by_count":49,"area":"alignment"},{"id":"2405.20495","title":"Transfer Q Star: Principled Decoding for LLM Alignment","created":"2024-05-30","cited_by_count":48,"area":"alignment"},{"id":"2405.17374","title":"Navigating the Safety Landscape: Measuring Risks in Finetuning Large Language Models","created":"2024-05-27","cited_by_count":46,"area":"alignment"},{"id":"2503.17126","title":"Modifying Large Language Model Post-Training for Diverse Creative Writing","created":"2025-03-21","cited_by_count":40,"area":"alignment"},{"id":"2502.12668","title":"Evaluation of Best-of-N Sampling Strategies for Language Model Alignment","created":"2025-02-18","cited_by_count":39,"area":"alignment"},{"id":"2404.16792","title":"Model Extrapolation Expedites Alignment","created":"2024-04-25","cited_by_count":37,"area":"alignment"},{"id":"2402.13659","title":"Privacy-Preserving Instructions for Aligning Large Language Models","created":"2024-02-21","cited_by_count":35,"area":"alignment"},{"id":"2409.14586","title":"Backtracking Improves Generation Safety","created":"2024-09-22","cited_by_count":32,"area":"alignment"},{"id":"2406.16235","title":"Preference Tuning For Toxicity Mitigation Generalizes Across Languages","created":"2024-06-23","cited_by_count":31,"area":"alignment"},{"id":"2405.16229","title":"No Two Devils Alike: Unveiling Distinct Mechanisms of Fine-tuning Attacks","created":"2024-05-25","cited_by_count":29,"area":"alignment"},{"id":"2506.17871","title":"LLM Probability Concentration: How Alignment Shrinks the Generative Horizon","created":"2025-06-22","cited_by_count":26,"area":"alignment"},{"id":"2310.11971","title":"Improving Generalization of Alignment with Human Preferences through Group Invariant Learning","created":"2023-10-18","cited_by_count":25,"area":"alignment"},{"id":"2404.01054","title":"Regularized Best-of-N Sampling with Minimum Bayes Risk Objective for Language Model Alignment","created":"2024-04-01","cited_by_count":25,"area":"alignment"},{"id":"2505.14442","title":"Creative Preference Optimization","created":"2025-05-20","cited_by_count":25,"area":"alignment"},{"id":"2411.01834","title":"Align-SLM: Textless Spoken Language Models with Reinforcement Learning from AI Feedback","created":"2024-11-04","cited_by_count":23,"area":"alignment"},{"id":"2412.10432","title":"Imitate Before Detect: Aligning Machine Stylistic Preference for Machine-Revised Text Detection","created":"2024-12-11","cited_by_count":23,"area":"alignment"},{"id":"2310.02368","title":"Reinforcement Learning from Automatic Feedback for High-Quality Unit Test Generation","created":"2023-10-03","cited_by_count":21,"area":"alignment"},{"id":"2404.19409","title":"Countering Reward Over-optimization in LLM with Demonstration-Guided Reinforcement Learning","created":"2024-04-30","cited_by_count":20,"area":"alignment"},{"id":"2502.09604","title":"SelfCite: Self-Supervised Alignment for Context Attribution in Large Language Models","created":"2025-02-13","cited_by_count":20,"area":"alignment"},{"id":"2311.09132","title":"Aligning Neural Machine Translation Models: Human Feedback in Training and Inference","created":"2023-11-15","cited_by_count":19,"area":"alignment"},{"id":"2410.16027","title":"ComPO: Community Preferences for Language Model Personalization","created":"2024-10-21","cited_by_count":19,"area":"alignment"},{"id":"2202.09662","title":"Reward Modeling for Mitigating Toxicity in Transformer-based Language Models","created":"2022-02-19","cited_by_count":18,"area":"alignment"},{"id":"2405.19744","title":"X-Instruction: Aligning Language Model in Low-resource Languages with Self-curated Cross-lingual Instructions","created":"2024-05-30","cited_by_count":18,"area":"alignment"},{"id":"2503.02574","title":"LLM-Safety Evaluations Lack Robustness","created":"2025-03-04","cited_by_count":18,"area":"alignment"},{"id":"2409.02795","title":"Towards a Unified View of Preference Learning for Large Language Models: A Survey","created":"2024-09-04","cited_by_count":17,"area":"alignment"},{"id":"2408.04614","title":"Better Alignment with Instruction Back-and-Forth Translation","created":"2024-08-08","cited_by_count":16,"area":"alignment"},{"id":"2402.14688","title":"Q-Probe: A Lightweight Approach to Reward Maximization for Language Models","created":"2024-02-22","cited_by_count":15,"area":"alignment"},{"id":"2406.10977","title":"Toward Optimal LLM Alignments Using Two-Player Games","created":"2024-06-16","cited_by_count":13,"area":"alignment"},{"id":"2406.11715","title":"Measuring memorization in RLHF for code completion","created":"2024-06-17","cited_by_count":13,"area":"alignment"},{"id":"2407.16637","title":"Course-Correction: Safety Alignment Using Synthetic Preferences","created":"2024-07-23","cited_by_count":13,"area":"alignment"},{"id":"2502.14289","title":"Drift: Decoding-time Personalized Alignments with Implicit User Preferences","created":"2025-02-20","cited_by_count":13,"area":"alignment"},{"id":"2403.03419","title":"Negating Negatives: Alignment with Human Negative Samples via Distributional Dispreference Optimization","created":"2024-03-06","cited_by_count":11,"area":"alignment"},{"id":"2305.17760","title":"Language Models are Bounded Pragmatic Speakers: Understanding RLHF from a Bayesian Cognitive Modeling Perspective","created":"2023-05-28","cited_by_count":10,"area":"alignment"},{"id":"2409.00787","title":"The Dark Side of Human Feedback: Poisoning Large Language Models via User Inputs","created":"2024-09-01","cited_by_count":10,"area":"alignment"},{"id":"2411.09661","title":"Adaptive Decoding via Latent Preference Optimization","created":"2024-11-14","cited_by_count":10,"area":"alignment"},{"id":"2406.18118","title":"SafeAligner: Safety Alignment against Jailbreak Attacks via Response Disparity Guidance","created":"2024-06-26","cited_by_count":9,"area":"alignment"},{"id":"2403.14238","title":"Reinforcement Learning from Reflective Feedback (RLRF): Aligning and Improving LLMs via Fine-Grained Self-Reflection","created":"2024-03-21","cited_by_count":8,"area":"alignment"},{"id":"2409.18618","title":"Model-based Preference Optimization in Abstractive Summarization without Human Feedback","created":"2024-09-27","cited_by_count":7,"area":"alignment"},{"id":"2410.03818","title":"Large Language Models can be Strong Self-Detoxifiers","created":"2024-10-04","cited_by_count":7,"area":"alignment"},{"id":"2410.15096","title":"GDPO: Learning to Directly Align Language Models with Diversity Using GFlowNets","created":"2024-10-19","cited_by_count":6,"area":"alignment"},{"id":"2501.17295","title":"Mitigating Hallucinated Translations in Large Language Models with Hallucination-focused Preference Optimization","created":"2025-01-28","cited_by_count":6,"area":"alignment"},{"id":"2510.18053","title":"Adaptive Divergence Regularized Policy Optimization for Fine-tuning Generative Models","created":"2025-10-20","cited_by_count":6,"area":"alignment"},{"id":"2409.17673","title":"Cross-lingual Human-Preference Alignment for Neural Machine Translation with Direct Quality Optimization","created":"2024-09-26","cited_by_count":5,"area":"alignment"},{"id":"2410.08458","title":"Simultaneous Reward Distillation and Preference Learning: Get You a Language Model Who Can Do Both","created":"2024-10-11","cited_by_count":5,"area":"alignment"},{"id":"2502.04517","title":"Towards Cost-Effective Reward Guided Text Generation","created":"2025-02-06","cited_by_count":5,"area":"alignment"},{"id":"2406.08842","title":"ContraSolver: Self-Alignment of Language Models by Resolving Internal Preference Contradictions","created":"2024-06-13","cited_by_count":4,"area":"alignment"},{"id":"2411.07595","title":"Entropy Controllable Direct Preference Optimization","created":"2024-11-12","cited_by_count":4,"area":"alignment"},{"id":"2411.09341","title":"Approximated Variational Bayesian Inverse Reinforcement Learning for Large Language Model Alignment","created":"2024-11-14","cited_by_count":4,"area":"alignment"},{"id":"2504.09895","title":"Learning from Reference Answers: Versatile Language Model Alignment without Binary Human Preference Data","created":"2025-04-14","cited_by_count":4,"area":"alignment"},{"id":"2504.16628","title":"ParetoHqD: Fast Offline Multiobjective Alignment of Large Language Models using Pareto High-quality Data","created":"2025-04-23","cited_by_count":4,"area":"alignment"},{"id":"2512.12066","title":"The Instability of Safety: How Random Seeds and Temperature Expose Inconsistent LLM Refusal Behavior","created":"2025-12-12","cited_by_count":4,"area":"alignment"},{"id":"2605.00195","title":"Diversity in Large Language Models under Supervised Fine-Tuning","created":"2026-04-30","cited_by_count":4,"area":"alignment"},{"id":"2605.04266","title":"Explaining and Preventing Alignment Collapse in Iterative RLHF","created":"2026-05-05","cited_by_count":4,"area":"alignment"},{"id":"2405.13541","title":"Annotation-Efficient Language Model Alignment via Diverse and Representative Response Texts","created":"2024-05-22","cited_by_count":3,"area":"alignment"},{"id":"2407.04615","title":"On the Low-Rank Parametrization of Reward Models for Controlled Language Generation","created":"2024-07-05","cited_by_count":3,"area":"alignment"},{"id":"2407.09447","title":"ASTPrompter: Preference-Aligned Automated Language Model Red-Teaming to Generate Low-Perplexity Unsafe Prompts","created":"2024-07-12","cited_by_count":3,"area":"alignment"},{"id":"2502.08657","title":"Refining Positive and Toxic Samples for Dual Safety Self-Alignment of LLMs with Minimal Human Interventions","created":"2025-02-08","cited_by_count":3,"area":"alignment"},{"id":"2511.17937","title":"Alignment Faking - the Train -> Deploy Asymmetry: Through a Game-Theoretic Lens with Bayesian-Stackelberg Equilibria","created":"2025-11-22","cited_by_count":3,"area":"alignment"},{"id":"2010.11553","title":"Incorporating Stylistic Lexical Preferences in Generative Language Models","created":"2020-10-22","cited_by_count":2,"area":"alignment"},{"id":"2402.18284","title":"Is Crowdsourcing Breaking Your Bank? Cost-Effective Fine-Tuning of Pre-trained Language Models with Proximal Policy Optimization","created":"2024-02-28","cited_by_count":2,"area":"alignment"},{"id":"2503.00029","title":"Streaming Looking Ahead with Token-level Self-reward","created":"2025-02-24","cited_by_count":2,"area":"alignment"},{"id":"2503.12528","title":"Investigating Human-Aligned Large Language Model Uncertainty","created":"2025-03-16","cited_by_count":2,"area":"alignment"},{"id":"2507.07723","title":"Stable Preference Optimization: A Bilevel Approach to Catastrophic Preference Shift","created":"2025-07-10","cited_by_count":2,"area":"alignment"},{"id":"2510.21883","title":"Language Ranker: A Lightweight Ranking framework for LLM Decoding","created":"2025-10-23","cited_by_count":2,"area":"alignment"},{"id":"2603.14355","title":"Exposing Long-Tail Safety Failures in Large Language Models through Efficient Diverse Response Sampling","created":"2026-03-15","cited_by_count":2,"area":"alignment"},{"id":"2604.02174","title":"Quantifying Self-Preservation Bias in Large Language Models","created":"2026-04-02","cited_by_count":2,"area":"alignment"},{"id":"2604.17132","title":"Please refuse to answer me! Mitigating Over-Refusal in Large Language Models via Adaptive Contrastive Decoding","created":"2026-04-18","cited_by_count":2,"area":"alignment"},{"id":"2404.12150","title":"Aligning language models with human preferences","created":"2024-04-18","cited_by_count":1,"area":"alignment"},{"id":"2406.16377","title":"On the Transformations across Reward Model, Parameter Update, and In-Context Prompt","created":"2024-06-24","cited_by_count":1,"area":"alignment"},{"id":"2505.13257","title":"Is Active Persona Inference Necessary for Aligning Small Models to Personal Preferences?","created":"2025-05-19","cited_by_count":1,"area":"alignment"},{"id":"2506.06444","title":"Saffron-1: Safety Inference Scaling","created":"2025-06-06","cited_by_count":1,"area":"alignment"},{"id":"2509.26169","title":"Alignment-Aware Decoding","created":"2025-09-30","cited_by_count":1,"area":"alignment"},{"id":"2603.05231","title":"Boosting ASR Robustness via Test-Time Reinforcement Learning with Audio-Text Semantic Rewards","created":"2026-03-05","cited_by_count":1,"area":"alignment"},{"id":"2606.29933","title":"Towards Physical Intuitions for Alignment Dynamics: A Case Study With Randomness Crystallization","created":"2026-06-29","cited_by_count":1,"area":"alignment"},{"id":"2609.14896","title":"Forty Shades of Blue: Quality-Diversity Alignment via Mode-Conditioned Reinforcement Learning","created":"2026-09-14","cited_by_count":1,"area":"alignment"},{"id":"2406.10203","title":"A Probability--Quality Trade-off in Aligned Language Models and its Relation to Sampling Adaptors","created":"2024-06-14","cited_by_count":0,"area":"alignment"},{"id":"2412.14308","title":"Reinforcement Learning from Automatic Feedback for High-Quality Unit Test Generation","created":"2024-12-18","cited_by_count":0,"area":"alignment"},{"id":"2508.02063","title":"TRACEALIGN -- Tracing the Drift: Attributing Alignment Failures to Training-Time Belief Sources in LLMs","created":"2025-08-04","cited_by_count":0,"area":"alignment"}],"next_cursor":"100"}