{"total":176,"rows":[{"id":"2403.04132","title":"Chatbot Arena: An Open Platform for Evaluating LLMs by Human Preference","created":"2024-03-07","cited_by_count":1184,"area":"alignment"},{"id":"2305.11206","title":"LIMA: Less Is More for Alignment","created":"2023-05-18","cited_by_count":1100,"area":"alignment"},{"id":"2405.14734","title":"SimPO: Simple Preference Optimization with a Reference-Free Reward","created":"2024-05-23","cited_by_count":963,"area":"alignment"},{"id":"2401.10020","title":"Self-Rewarding Language Models","created":"2024-01-18","cited_by_count":681,"area":"alignment"},{"id":"2310.06452","title":"Understanding the Effects of RLHF on LLM Generalisation and Diversity","created":"2023-10-10","cited_by_count":396,"area":"alignment"},{"id":"2312.15685","title":"What Makes Good Data for Alignment? A Comprehensive Study of Automatic Data Selection in Instruction Tuning","created":"2023-12-25","cited_by_count":364,"area":"alignment"},{"id":"2305.03047","title":"Principle-Driven Self-Alignment of Language Models from Scratch with Minimal Human Supervision","created":"2023-05-04","cited_by_count":318,"area":"alignment"},{"id":"2310.02949","title":"Shadow Alignment: The Ease of Subverting Safely-Aligned Language Models","created":"2023-10-04","cited_by_count":297,"area":"alignment"},{"id":"2306.04488","title":"Rewarded soups: towards Pareto-optimal alignment by interpolating weights fine-tuned on diverse rewards","created":"2023-06-07","cited_by_count":243,"area":"alignment"},{"id":"2310.02743","title":"Reward Model Ensembles Help Mitigate Overoptimization","created":"2023-10-04","cited_by_count":231,"area":"alignment"},{"id":"2311.10702","title":"Camels in a Changing Climate: Enhancing LM Adaptation with Tulu 2","created":"2023-11-17","cited_by_count":229,"area":"alignment"},{"id":"2307.10928","title":"FLASK: Fine-grained Language Model Evaluation based on Alignment Skill Sets","created":"2023-07-20","cited_by_count":201,"area":"alignment"},{"id":"2401.06080","title":"Secrets of RLHF in Large Language Models Part II: Reward Modeling","created":"2024-01-11","cited_by_count":171,"area":"alignment"},{"id":"2402.18571","title":"Arithmetic Control of LLMs for Diverse User Preferences: Directional Preference Alignment with Multi-Objective Rewards","created":"2024-02-28","cited_by_count":148,"area":"alignment"},{"id":"2404.16019","title":"The PRISM Alignment Dataset: What Participatory, Representative and Individualised Human Feedback Reveals About the Subjective and Multicultural Alignment of Large Language Models","created":"2024-04-24","cited_by_count":144,"area":"alignment"},{"id":"2311.04155","title":"Black-Box Prompt Optimization: Aligning Large Language Models without Model Training","created":"2023-11-07","cited_by_count":122,"area":"alignment"},{"id":"2310.05344","title":"SteerLM: Attribute Conditioned SFT as an (User-Steerable) Alternative to RLHF","created":"2023-10-09","cited_by_count":111,"area":"alignment"},{"id":"2402.01878","title":"LiPO: Listwise Preference Optimization through Learning-to-Rank","created":"2024-02-02","cited_by_count":96,"area":"alignment"},{"id":"2405.17977","title":"Aligning to Thousands of Preferences via System Message Generalization","created":"2024-05-28","cited_by_count":84,"area":"alignment"},{"id":"2402.09345","title":"InfoRM: Mitigating Reward Hacking in RLHF via Information-Theoretic Reward Modeling","created":"2024-02-14","cited_by_count":79,"area":"alignment"},{"id":"2402.00782","title":"Dense Reward for Free in Reinforcement Learning from Human Feedback","created":"2024-02-01","cited_by_count":78,"area":"alignment"},{"id":"2305.13735","title":"Aligning Large Language Models through Synthetic Feedback","created":"2023-05-23","cited_by_count":75,"area":"alignment"},{"id":"2309.12053","title":"AceGPT, Localizing Large Language Models in Arabic","created":"2023-09-21","cited_by_count":75,"area":"alignment"},{"id":"2402.15018","title":"Unintended Impacts of LLM Alignment on Global Representation","created":"2024-02-22","cited_by_count":66,"area":"alignment"},{"id":"2405.19332","title":"Self-Exploring Language Models: Active Preference Elicitation for Online Alignment","created":"2024-05-29","cited_by_count":63,"area":"alignment"},{"id":"2310.05910","title":"SALMON: Self-Alignment with Instructable Reward Models","created":"2023-10-09","cited_by_count":55,"area":"alignment"},{"id":"2402.10038","title":"RS-DPO: A Hybrid Rejection Sampling and Direct Preference Optimization Method for Alignment of Large Language Models","created":"2024-02-15","cited_by_count":48,"area":"alignment"},{"id":"2405.19534","title":"Preference Learning Algorithms Do Not Learn Preference Rankings","created":"2024-05-29","cited_by_count":48,"area":"alignment"},{"id":"2405.01525","title":"FLAME: Factuality-Aware Alignment for Large Language Models","created":"2024-05-02","cited_by_count":47,"area":"alignment"},{"id":"2410.14632","title":"Diverging Preferences: When do Annotators Disagree and do Models Know?","created":"2024-10-18","cited_by_count":47,"area":"alignment"},{"id":"2308.12014","title":"From Instructions to Intrinsic Human Values -- A Survey of Alignment Goals for Big Models","created":"2023-08-23","cited_by_count":45,"area":"alignment"},{"id":"2405.19358","title":"Robustifying Safety-Aligned Large Language Models through Clean Data Curation","created":"2024-05-24","cited_by_count":44,"area":"alignment"},{"id":"2306.10968","title":"BayLing: Bridging Cross-lingual Alignment and Instruction Following through Interactive Translation for Large Language Models","created":"2023-06-19","cited_by_count":42,"area":"alignment"},{"id":"2503.17003","title":"A Survey on Personalized Alignment -- The Missing Piece for Large Language Models in Real-World Applications","created":"2025-03-21","cited_by_count":42,"area":"alignment"},{"id":"2403.07230","title":"Curry-DPO: Enhancing Alignment using Curriculum Learning & Ranked Preferences","created":"2024-03-12","cited_by_count":39,"area":"alignment"},{"id":"2404.05875","title":"CodecLM: Aligning Language Models with Tailored Synthetic Data","created":"2024-04-08","cited_by_count":39,"area":"alignment"},{"id":"2502.12668","title":"Evaluation of Best-of-N Sampling Strategies for Language Model Alignment","created":"2025-02-18","cited_by_count":39,"area":"alignment"},{"id":"2403.14221","title":"Improving the Robustness of Large Language Models via Consistency Alignment","created":"2024-03-21","cited_by_count":36,"area":"alignment"},{"id":"2402.13210","title":"Bayesian Reward Models for LLM Alignment","created":"2024-02-20","cited_by_count":35,"area":"alignment"},{"id":"2410.17578","title":"MM-Eval: A Multilingual Meta-Evaluation Benchmark for LLM-as-a-Judge and Reward Models","created":"2024-10-23","cited_by_count":35,"area":"alignment"},{"id":"2406.19371","title":"Suri: Multi-constraint Instruction Following for Long-form Text Generation","created":"2024-06-27","cited_by_count":34,"area":"alignment"},{"id":"2308.05696","title":"A Preliminary Study of the Intrinsic Relationship between Complexity and Alignment","created":"2023-08-10","cited_by_count":33,"area":"alignment"},{"id":"2604.13602","title":"Reward Hacking in the Era of Large Models: Mechanisms, Emergent Misalignment, Challenges","created":"2026-04-15","cited_by_count":33,"area":"alignment"},{"id":"2307.12966","title":"Aligning Large Language Models with Human: A Survey","created":"2023-07-24","cited_by_count":32,"area":"alignment"},{"id":"2405.19262","title":"Weak-to-Strong Search: Align Large Language Models via Searching over Small Language Models","created":"2024-05-29","cited_by_count":32,"area":"alignment"},{"id":"2409.14586","title":"Backtracking Improves Generation Safety","created":"2024-09-22","cited_by_count":32,"area":"alignment"},{"id":"2408.15549","title":"WildFeedback: Aligning LLMs With In-situ User Interactions And Feedback","created":"2024-08-28","cited_by_count":31,"area":"alignment"},{"id":"2409.05283","title":"On the Relationship between Truth and Political Bias in Language Models","created":"2024-09-09","cited_by_count":31,"area":"alignment"},{"id":"2310.03304","title":"Learning Personalized Alignment for Evaluating Open-ended Text Generation","created":"2023-10-05","cited_by_count":29,"area":"alignment"},{"id":"2311.17487","title":"Taiwan LLM: Bridging the Linguistic Divide with a Culturally Aligned Language Model","created":"2023-11-29","cited_by_count":29,"area":"alignment"},{"id":"2408.02085","title":"Unleashing the Power of Data Tsunami: A Comprehensive Survey on Data Assessment and Selection for Instruction Tuning of Language Models","created":"2024-08-04","cited_by_count":29,"area":"alignment"},{"id":"2410.10148","title":"AlphaDPO: Adaptive Reward Margin for Direct Preference Optimization","created":"2024-10-14","cited_by_count":29,"area":"alignment"},{"id":"2402.09764","title":"Aligning Crowd Feedback via Distributional Preference Reward Modeling","created":"2024-02-15","cited_by_count":28,"area":"alignment"},{"id":"2406.07739","title":"UICoder: Finetuning Large Language Models to Generate User Interface Code through Automated Feedback","created":"2024-06-11","cited_by_count":27,"area":"alignment"},{"id":"2310.01581","title":"On the Safety of Open-Sourced Large Language Models: Does Alignment Really Prevent Them From Being Misused?","created":"2023-10-02","cited_by_count":26,"area":"alignment"},{"id":"2312.07401","title":"On Diversified Preferences of Large Language Model Alignment","created":"2023-12-12","cited_by_count":26,"area":"alignment"},{"id":"2404.12318","title":"Reuse Your Rewards: Reward Model Transfer for Zero-Shot Cross-Lingual Alignment","created":"2024-04-18","cited_by_count":26,"area":"alignment"},{"id":"2404.01054","title":"Regularized Best-of-N Sampling with Minimum Bayes Risk Objective for Language Model Alignment","created":"2024-04-01","cited_by_count":25,"area":"alignment"},{"id":"2506.15421","title":"Reward Models in Deep Reinforcement Learning: A Survey","created":"2025-06-18","cited_by_count":25,"area":"alignment"},{"id":"2406.11191","title":"A Survey on Human Preference Learning for Large Language Models","created":"2024-06-17","cited_by_count":24,"area":"alignment"},{"id":"2403.04204","title":"On the Essence and Prospect: An Investigation of Alignment Approaches for Big Models","created":"2024-03-07","cited_by_count":21,"area":"alignment"},{"id":"2409.09603","title":"Towards Data-Centric RLHF: Simple Metrics for Preference Dataset Comparison","created":"2024-09-15","cited_by_count":21,"area":"alignment"},{"id":"2309.09055","title":"Exploring the impact of low-rank adaptation on the performance, efficiency, and regularization of RLHF","created":"2023-09-16","cited_by_count":20,"area":"alignment"},{"id":"2404.19409","title":"Countering Reward Over-optimization in LLM with Demonstration-Guided Reinforcement Learning","created":"2024-04-30","cited_by_count":20,"area":"alignment"},{"id":"2501.11549","title":"Whose Boat Does it Float? Improving Personalization in Preference Tuning via Inferred User Personas","created":"2025-01-20","cited_by_count":19,"area":"alignment"},{"id":"2311.14743","title":"A Baseline Analysis of Reward Models' Ability To Accurately Analyze Foundation Models Under Distribution Shift","created":"2023-11-21","cited_by_count":18,"area":"alignment"},{"id":"2405.13432","title":"Disperse-Then-Merge: Pushing the Limits of Instruction Tuning via Alignment Tax Reduction","created":"2024-05-22","cited_by_count":18,"area":"alignment"},{"id":"2405.19744","title":"X-Instruction: Aligning Language Model in Low-resource Languages with Self-curated Cross-lingual Instructions","created":"2024-05-30","cited_by_count":18,"area":"alignment"},{"id":"2406.10630","title":"Emerging Safety Attack and Defense in Federated Instruction Tuning of Large Language Models","created":"2024-06-15","cited_by_count":18,"area":"alignment"},{"id":"2506.17252","title":"Adaptive Batch-Wise Sample Scheduling for Direct Preference Optimization","created":"2025-06-08","cited_by_count":17,"area":"alignment"},{"id":"2408.04614","title":"Better Alignment with Instruction Back-and-Forth Translation","created":"2024-08-08","cited_by_count":16,"area":"alignment"},{"id":"2402.12219","title":"Reformatted Alignment","created":"2024-02-19","cited_by_count":15,"area":"alignment"},{"id":"2402.14688","title":"Q-Probe: A Lightweight Approach to Reward Maximization for Language Models","created":"2024-02-22","cited_by_count":15,"area":"alignment"},{"id":"2504.05154","title":"CARE: Multilingual Human Preference Learning for Cultural Awareness","created":"2025-04-07","cited_by_count":15,"area":"alignment"},{"id":"2308.12050","title":"Aligning Language Models with Offline Learning from Human Feedback","created":"2023-08-23","cited_by_count":14,"area":"alignment"},{"id":"2309.10202","title":"Stabilizing RLHF through Advantage Model and Selective Rehearsal","created":"2023-09-18","cited_by_count":14,"area":"alignment"},{"id":"2407.10944","title":"Naturally Occurring Feedback is Common, Extractable and Useful","created":"2024-07-15","cited_by_count":14,"area":"alignment"},{"id":"2407.03038","title":"Towards Federated RLHF with Aggregated Client Preference for LLMs","created":"2024-07-03","cited_by_count":13,"area":"alignment"},{"id":"2410.05269","title":"Data Advisor: Dynamic Data Curation for Safety Alignment of Large Language Models","created":"2024-10-07","cited_by_count":13,"area":"alignment"},{"id":"2505.07437","title":"LEAD: Iterative Data Selection for Efficient LLM Instruction Tuning","created":"2025-05-12","cited_by_count":13,"area":"alignment"},{"id":"2506.03690","title":"Robust Preference Optimization via Dynamic Target Margins","created":"2025-06-04","cited_by_count":13,"area":"alignment"},{"id":"2510.20369","title":"Ask a Strong LLM Judge when Your Reward Model is Uncertain","created":"2025-10-23","cited_by_count":13,"area":"alignment"},{"id":"2410.01532","title":"Seeing Eye to AI: Human Alignment via Gaze-Based Response Rewards for Large Language Models","created":"2024-10-02","cited_by_count":12,"area":"alignment"},{"id":"2505.18126","title":"Reward Model Overoptimisation in Iterated RLHF","created":"2025-05-23","cited_by_count":12,"area":"alignment"},{"id":"2508.18312","title":"What Matters in Data for DPO?","created":"2025-08-23","cited_by_count":12,"area":"alignment"},{"id":"2403.03419","title":"Negating Negatives: Alignment with Human Negative Samples via Distributional Dispreference Optimization","created":"2024-03-06","cited_by_count":11,"area":"alignment"},{"id":"2404.11773","title":"Behavior Alignment: A New Perspective of Evaluating LLM-based Conversational Recommender Systems","created":"2024-04-17","cited_by_count":11,"area":"alignment"},{"id":"2403.12805","title":"Contextual Moral Value Alignment Through Context-Based Aggregation","created":"2024-03-19","cited_by_count":10,"area":"alignment"},{"id":"2406.16316","title":"Does Cross-Cultural Alignment Change the Commonsense Morality of Language Models?","created":"2024-06-24","cited_by_count":10,"area":"alignment"},{"id":"2408.16961","title":"The Future of Open Human Feedback","created":"2024-08-15","cited_by_count":10,"area":"alignment"},{"id":"2412.16834","title":"Online Learning from Strategic Human Feedback in LLM Fine-Tuning","created":"2024-12-22","cited_by_count":10,"area":"alignment"},{"id":"2307.00279","title":"Let Me Teach You: Pedagogical Foundations of Feedback for Language Models","created":"2023-07-01","cited_by_count":9,"area":"alignment"},{"id":"2404.04932","title":"Towards Understanding the Influence of Reward Margin on Preference Model Performance","created":"2024-04-07","cited_by_count":9,"area":"alignment"},{"id":"2404.18870","title":"More RLHF, More Trust? On The Impact of Preference Alignment On Trustworthiness","created":"2024-04-29","cited_by_count":9,"area":"alignment"},{"id":"2410.11055","title":"Varying Shades of Wrong: Aligning LLMs with Wrong Answers Only","created":"2024-10-14","cited_by_count":9,"area":"alignment"},{"id":"2411.16502","title":"Interpreting Language Reward Models via Contrastive Explanations","created":"2024-11-25","cited_by_count":9,"area":"alignment"},{"id":"2502.16825","title":"Finding the Sweet Spot: Preference Data Construction for Scaling Preference Optimization","created":"2025-02-24","cited_by_count":9,"area":"alignment"},{"id":"2506.04463","title":"Aligning Large Language Models with Implicit Preferences from User-Generated Content","created":"2025-06-04","cited_by_count":9,"area":"alignment"},{"id":"2506.04721","title":"SPARTA ALIGNMENT: Collectively Aligning Multiple Language Models through Combat","created":"2025-06-05","cited_by_count":9,"area":"alignment"},{"id":"2511.14476","title":"Operationalizing Pluralistic Values in Large Language Model Alignment Reveals Trade-offs in Safety, Inclusivity, and Model Behavior","created":"2025-11-18","cited_by_count":9,"area":"alignment"}],"next_cursor":"100"}