{"list":"other","total":80,"rows":[{"id":"2203.02155","title":"Training language models to follow instructions with human feedback","created":"2022-03-04","cited_by_count":15971},{"id":"2305.18290","title":"Direct Preference Optimization: Your Language Model is Secretly a Reward Model","created":"2023-05-29","cited_by_count":8065},{"id":"1706.03741","title":"Deep reinforcement learning from human preferences","created":"2017-06-12","cited_by_count":3912},{"id":"2204.05862","title":"Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedback","created":"2022-04-12","cited_by_count":3720},{"id":"1909.08593","title":"Fine-Tuning Language Models from Human Preferences","created":"2019-09-18","cited_by_count":2150},{"id":"2210.10760","title":"Scaling Laws for Reward Model Overoptimization","created":"2022-10-19","cited_by_count":1095},{"id":"2202.03286","title":"Red Teaming Language Models with Language Models","created":"2022-02-07","cited_by_count":1026},{"id":"2303.17548","title":"Whose Opinions Do Language Models Reflect?","created":"2023-03-30","cited_by_count":773},{"id":"2307.15217","title":"Open Problems and Fundamental Limitations of Reinforcement Learning from Human Feedback","created":"2023-07-27","cited_by_count":759},{"id":"2209.07858","title":"Red Teaming Language Models to Reduce Harms: Methods, Scaling Behaviors, and Lessons Learned","created":"2022-08-23","cited_by_count":729},{"id":"2505.22617","title":"The Entropy Mechanism of Reinforcement Learning for Reasoning Language Models","created":"2025-05-28","cited_by_count":485},{"id":"2001.09768","title":"Artificial Intelligence, Values and Alignment","created":"2020-01-13","cited_by_count":448},{"id":"1811.07871","title":"Scalable agent alignment via reward modeling: a research direction","created":"2018-11-19","cited_by_count":447},{"id":"2310.06452","title":"Understanding the Effects of RLHF on LLM Generalisation and Diversity","created":"2023-10-10","cited_by_count":396},{"id":"1912.05511","title":"Measurement and Fairness","created":"2019-12-11","cited_by_count":308},{"id":"2109.13916","title":"Unsolved Problems in ML Safety","created":"2021-09-28","cited_by_count":292},{"id":"2312.14925","title":"A Survey of Reinforcement Learning from Human Feedback","created":"2023-12-22","cited_by_count":264},{"id":"2301.11270","title":"Principled Reinforcement Learning with Human Feedback from Pairwise or $K$-wise Comparisons","created":"2023-01-26","cited_by_count":247},{"id":"2405.00675","title":"Self-Play Preference Optimization for Language Model Alignment","created":"2024-05-01","cited_by_count":232},{"id":"2312.00886","title":"Nash Learning from Human Feedback","created":"2023-12-01","cited_by_count":224},{"id":"2404.09932","title":"Foundational Challenges in Assuring Alignment and Safety of Large Language Models","created":"2024-04-15","cited_by_count":199},{"id":"2404.03715","title":"Direct Nash Optimization: Teaching Language Models to Self-Improve with General Preferences","created":"2024-04-04","cited_by_count":178},{"id":"2103.14659","title":"Alignment of Language Agents","created":"2021-03-26","cited_by_count":168},{"id":"2408.10075","title":"Personalizing Reinforcement Learning from Human Feedback with Variational Preference Learning","created":"2024-08-19","cited_by_count":155},{"id":"2401.04056","title":"A Minimaximalist Approach to Reinforcement Learning from Human Feedback","created":"2024-01-08","cited_by_count":144},{"id":"2312.08358","title":"Distributional Preference Learning: Understanding and Accounting for Hidden Context in RLHF","created":"2023-12-13","cited_by_count":133},{"id":"2110.05699","title":"On Releasing Annotator-Level Labels and Information in Datasets","created":"2021-10-12","cited_by_count":126},{"id":"2402.08925","title":"MaxMin-RLHF: Alignment with Diverse Human Preferences","created":"2024-02-14","cited_by_count":123},{"id":"2012.11635","title":"A Distributional Approach to Controlled Text Generation","created":"2020-12-21","cited_by_count":119},{"id":"1502.06362","title":"Contextual Dueling Bandits","created":"2015-02-23","cited_by_count":101},{"id":"2309.00779","title":"Value Kaleidoscope: Engaging AI with Pluralistic Human Values, Rights, and Duties","created":"2023-09-02","cited_by_count":97},{"id":"2403.08635","title":"Human Alignment of Large Language Models through Online Preference Optimisation","created":"2024-03-13","cited_by_count":91},{"id":"2410.14872","title":"How to Evaluate Reward Models for RLHF","created":"2024-10-18","cited_by_count":88},{"id":"2405.00254","title":"RLHF from Heterogeneous Feedback via Personalization and Preference Aggregation","created":"2024-04-30","cited_by_count":74},{"id":"2405.16455","title":"On the Algorithmic Bias of Aligning Large Language Models with RLHF: Preference Collapse and Matching Regularization","created":"2024-05-26","cited_by_count":72},{"id":"2206.02231","title":"Models of human preference for learning reward functions","created":"2022-06-05","cited_by_count":54},{"id":"2405.14758","title":"Axioms for AI Alignment from Human Feedback","created":"2024-05-23","cited_by_count":52},{"id":"2405.19534","title":"Preference Learning Algorithms Do Not Learn Preference Rankings","created":"2024-05-29","cited_by_count":48},{"id":"2309.01291","title":"Generative Social Choice","created":"2023-09-03","cited_by_count":43},{"id":"2310.13595","title":"The History and Risks of Reinforcement Learning and Human Feedback","created":"2023-10-20","cited_by_count":42},{"id":"2101.06060","title":"The Challenge of Value Alignment: from Fairer Algorithms to AI Safety","created":"2021-01-15","cited_by_count":35},{"id":"2406.17692","title":"From Distributional to Overton Pluralism: Investigating Large Language Model Alignment","created":"2024-06-25","cited_by_count":33},{"id":"2410.05584","title":"Rethinking Reward Model Evaluation: Are We Barking up the Wrong Tree?","created":"2024-10-08","cited_by_count":31},{"id":"2310.05782","title":"Aligning Language Models with Human Preferences via a Bayesian Approach","created":"2023-10-09","cited_by_count":27},{"id":"2404.13038","title":"Mapping Social Choice Theory to RLHF","created":"2024-04-19","cited_by_count":27},{"id":"2511.08594","title":"Diverse Preference Learning for Capabilities and Alignment","created":"2025-10-29","cited_by_count":25},{"id":"2405.15065","title":"Direct Preference Optimization With Unobserved Preference Heterogeneity: The Necessity of Ternary Preferences","created":"2024-05-23","cited_by_count":23},{"id":"2602.01002","title":"How RLHF Amplifies Sycophancy","created":"2026-02-01","cited_by_count":23},{"id":"2505.23749","title":"Distortion of AI Alignment: Does Preference Optimization Optimize for Preferences?","created":"2025-05-29","cited_by_count":22},{"id":"2406.02764","title":"Adaptive Preference Scaling for Reinforcement Learning with Human Feedback","created":"2024-06-04","cited_by_count":20},{"id":"2502.10441","title":"AI Alignment at Your Discretion","created":"2025-02-10","cited_by_count":20},{"id":"2502.16320","title":"Direct Alignment with Heterogeneous Preferences","created":"2025-02-22","cited_by_count":19},{"id":"2103.00911","title":"Distortion in Social Choice Problems: The First 15 Years and Beyond","created":"2021-03-01","cited_by_count":17},{"id":"2501.19266","title":"Jackpot! Alignment as a Maximal Lottery","created":"2025-01-31","cited_by_count":17},{"id":"2412.11167","title":"Cultural Palette: Pluralising Culture Alignment via Multi-agent Palette","created":"2024-12-15","cited_by_count":16},{"id":"2410.03145","title":"Margin Matching Preference Optimization: Enhanced Model Alignment with Granular Feedback","created":"2024-10-04","cited_by_count":15},{"id":"2506.06298","title":"Pairwise Calibrated Rewards for Pluralistic Alignment","created":"2025-05-17","cited_by_count":14},{"id":"2302.00672","title":"'Generative CI' through Collective Response Systems","created":"2023-02-01","cited_by_count":13},{"id":"2312.03121","title":"Evaluating Agents using Social Choice Theory","created":"2023-12-05","cited_by_count":11},{"id":"2502.15145","title":"Projection Optimization: A General Framework for Multi-Objective and Multi-Group RLHF","created":"2025-02-21","cited_by_count":11},{"id":"2505.22939","title":"Generative Social Choice: The Next Generation","created":"2025-05-28","cited_by_count":10},{"id":"2501.09254","title":"Clone-Robust AI Alignment","created":"2025-01-16","cited_by_count":9},{"id":"2503.17338","title":"Capturing Individual Human Preferences with Reward Features","created":"2025-03-21","cited_by_count":8},{"id":"2405.17700","title":"Learning Social Welfare Functions","created":"2024-05-27","cited_by_count":7},{"id":"2506.12350","title":"Theoretical Tensions in RLHF: Reconciling Empirical Success with Inconsistencies in Social Choice Theory","created":"2025-06-14","cited_by_count":7},{"id":"2512.01351","title":"Benchmarking Overton Pluralism in LLMs","created":"2025-12-01","cited_by_count":7},{"id":"2505.19731","title":"Proximal Point Nash Learning from Human Feedback","created":"2025-05-26","cited_by_count":5},{"id":"2603.12595","title":"Swap-guided Preference Learning for Personalized Reinforcement Learning from Human Feedback","created":"2026-03-13","cited_by_count":5},{"id":"1503.00694","title":"Consistent Probabilistic Social Choice","created":"2015-02-21","cited_by_count":4},{"id":"2506.05619","title":"Beyond RLHF and NLHF: Population-Proportional Alignment under an Axiomatic Framework","created":"2025-06-05","cited_by_count":4},{"id":"2507.20403","title":"A General Framework for Estimating Preferences Using Response Time Data","created":"2025-07-27","cited_by_count":3},{"id":"2510.15839","title":"Learning Correlated Reward Models: Statistical Barriers and Opportunities","created":"2025-10-17","cited_by_count":3},{"id":"2210.04880","title":"Obvious Independence of Clones","created":"2022-10-10","cited_by_count":2},{"id":"2510.20020","title":"Optimized Distortion in Linear Social Choice","created":"2025-10-22","cited_by_count":2},{"id":"2601.18824","title":"Differential Voting: Loss Functions For Axiomatically Diverse Aggregation of Heterogeneous Preferences","created":"2026-01-25","cited_by_count":2},{"id":"2502.03576","title":"Clone-Robust Weights in Metric Spaces: Handling Redundancy Bias for Benchmark Aggregation","created":"2025-02-05","cited_by_count":1},{"id":"2602.21297","title":"Robust AI Evaluation through Maximal Lotteries","created":"2026-02-24","cited_by_count":1},{"id":"2603.19510","title":"Linear Social Choice with Few Queries: A Moment-Based Approach","created":"2026-03-19","cited_by_count":1},{"id":"2605.06987","title":"Response Time Enhances Alignment with Heterogeneous Preferences","created":"2026-05-07","cited_by_count":1},{"id":"2605.13307","title":"PRISM-X: Experiments on Personalised Fine-Tuning with Human and Simulated Users","created":"2026-05-13","cited_by_count":1}],"next_cursor":null}