{"list":"other","total":61,"rows":[{"id":"2203.02155","title":"Training language models to follow instructions with human feedback","created":"2022-03-04","cited_by_count":15971},{"id":"1707.06347","title":"Proximal Policy Optimization Algorithms","created":"2017-07-20","cited_by_count":15215},{"id":"1908.10084","title":"Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks","created":"2019-08-27","cited_by_count":9170},{"id":"2505.09388","title":"Qwen3 Technical Report","created":"2025-05-14","cited_by_count":8820},{"id":"2305.18290","title":"Direct Preference Optimization: Your Language Model is Secretly a Reward Model","created":"2023-05-29","cited_by_count":8065},{"id":"2009.03300","title":"Measuring Massive Multitask Language Understanding","created":"2020-09-07","cited_by_count":7963},{"id":"1905.07830","title":"HellaSwag: Can a Machine Really Finish Your Sentence?","created":"2019-05-19","cited_by_count":4100},{"id":"1706.03741","title":"Deep reinforcement learning from human preferences","created":"2017-06-12","cited_by_count":3912},{"id":"2109.01652","title":"Finetuned Language Models Are Zero-Shot Learners","created":"2021-09-03","cited_by_count":3780},{"id":"2204.05862","title":"Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedback","created":"2022-04-12","cited_by_count":3720},{"id":"1911.11641","title":"PIQA: Reasoning about Physical Commonsense in Natural Language","created":"2019-11-26","cited_by_count":2883},{"id":"2311.12022","title":"GPQA: A Graduate-Level Google-Proof Q&A Benchmark","created":"2023-11-20","cited_by_count":2879},{"id":"2212.10560","title":"Self-Instruct: Aligning Language Models with Self-Generated Instructions","created":"2022-12-20","cited_by_count":2724},{"id":"2310.13548","title":"Towards Understanding Sycophancy in Language Models","created":"2023-10-20","cited_by_count":1040},{"id":"2405.14734","title":"SimPO: Simple Preference Optimization with a Reference-Free Reward","created":"2024-05-23","cited_by_count":963},{"id":"2307.05782","title":"Large Language Models","created":"2023-07-11","cited_by_count":780},{"id":"2303.17548","title":"Whose Opinions Do Language Models Reflect?","created":"2023-03-30","cited_by_count":773},{"id":"2405.01470","title":"WildChat: 1M ChatGPT Interaction Logs in the Wild","created":"2024-05-02","cited_by_count":629},{"id":"2310.16944","title":"Zephyr: Direct Distillation of LM Alignment","created":"2023-10-25","cited_by_count":506},{"id":"2001.09768","title":"Artificial Intelligence, Values and Alignment","created":"2020-01-13","cited_by_count":448},{"id":"2306.16388","title":"Towards Measuring the Representation of Subjective Global Opinions in Language Models","created":"2023-06-28","cited_by_count":437},{"id":"2310.06452","title":"Understanding the Effects of RLHF on LLM Generalisation and Diversity","created":"2023-10-10","cited_by_count":396},{"id":"2412.14093","title":"Alignment faking in large language models","created":"2024-12-18","cited_by_count":360},{"id":"2402.13228","title":"Smaug: Fixing Failure Modes of Preference Optimisation with DPO-Positive","created":"2024-02-20","cited_by_count":241},{"id":"2307.04964","title":"Secrets of RLHF in Large Language Models Part I: PPO","created":"2023-07-11","cited_by_count":229},{"id":"2404.09932","title":"Foundational Challenges in Assuring Alignment and Safety of Large Language Models","created":"2024-04-15","cited_by_count":199},{"id":"2309.05196","title":"Does Writing with Language Models Reduce Content Diversity?","created":"2023-09-11","cited_by_count":192},{"id":"2308.03958","title":"Simple synthetic data reduces sycophancy in large language models","created":"2023-08-07","cited_by_count":187},{"id":"2307.00184","title":"Personality Traits in Large Language Models","created":"2023-07-01","cited_by_count":169},{"id":"2402.16786","title":"Political Compass or Spinning Arrow? Towards More Meaningful Evaluations for Values and Opinions in Large Language Models","created":"2024-02-26","cited_by_count":162},{"id":"2404.01413","title":"Is Model Collapse Inevitable? Breaking the Curse of Recursion by Accumulating Real and Synthetic Data","created":"2024-04-01","cited_by_count":151},{"id":"2110.07574","title":"Can Machines Learn Morality? The Delphi Experiment","created":"2021-10-14","cited_by_count":141},{"id":"2504.07912","title":"Echo Chamber: RL Post-training Amplifies Behaviors Learned in Pretraining","created":"2025-04-10","cited_by_count":129},{"id":"2206.07550","title":"Evaluating and Inducing Personality in Pre-trained Language Models","created":"2022-05-20","cited_by_count":123},{"id":"2309.12342","title":"Cultural Alignment in Large Language Models: An Explanatory Analysis Based on Hofstede's Cultural Dimensions","created":"2023-08-25","cited_by_count":112},{"id":"2406.09279","title":"Unpacking DPO and PPO: Disentangling Best Practices for Learning from Preference Feedback","created":"2024-06-13","cited_by_count":107},{"id":"2407.10490","title":"Learning Dynamics of LLM Finetuning","created":"2024-07-15","cited_by_count":95},{"id":"2211.13972","title":"Picking on the Same Person: Does Algorithmic Monoculture lead to Outcome Homogenization?","created":"2022-11-25","cited_by_count":91},{"id":"2410.24190","title":"Hidden Persuaders: LLMs' Political Leaning and Their Influence on Voters","created":"2024-10-31","cited_by_count":71},{"id":"2404.04626","title":"Towards Analyzing and Understanding the Limitations of DPO: A Theoretical Perspective","created":"2024-04-06","cited_by_count":69},{"id":"2402.15018","title":"Unintended Impacts of LLM Alignment on Global Representation","created":"2024-02-22","cited_by_count":66},{"id":"2407.02996","title":"Are Large Language Models Consistent over Value-laden Questions?","created":"2024-07-03","cited_by_count":58},{"id":"2307.16180","title":"Do LLMs Possess a Personality? Making the MBTI Test an Amazing Evaluation for Large Language Models","created":"2023-07-30","cited_by_count":56},{"id":"2403.07857","title":"Fairness Feedback Loops: Training on Synthetic Data Amplifies Bias","created":"2024-03-12","cited_by_count":55},{"id":"2504.15236","title":"Values in the Wild: Discovering and Analyzing Values in Real-World Language Model Interactions","created":"2025-04-21","cited_by_count":52},{"id":"2403.17031","title":"The N+ Implementation Details of RLHF with PPO: A Case Study on TL;DR Summarization","created":"2024-03-24","cited_by_count":50},{"id":"2505.11711","title":"Reinforcement Learning Finetunes Small Subnetworks in Large Language Models","created":"2025-05-16","cited_by_count":49},{"id":"2405.19534","title":"Preference Learning Algorithms Do Not Learn Preference Rankings","created":"2024-05-29","cited_by_count":48},{"id":"2403.07230","title":"Curry-DPO: Enhancing Alignment using Curriculum Learning & Ranked Preferences","created":"2024-03-12","cited_by_count":39},{"id":"2507.06187","title":"The Delta Learning Hypothesis: Preference Tuning on Weak Data can Yield Strong Gains","created":"2025-07-08","cited_by_count":28},{"id":"2403.19443","title":"Mixed Preference Optimization: Reinforcement Learning with Data Selection and Better Reference Model","created":"2024-03-28","cited_by_count":25},{"id":"2407.02209","title":"Generative Monoculture in Large Language Models","created":"2024-07-02","cited_by_count":22},{"id":"2402.13887","title":"Beyond Probabilities: Unveiling the Misalignment in Evaluating Large Language Models","created":"2024-02-21","cited_by_count":19},{"id":"2502.05475","title":"You Are What You Eat -- AI Alignment Requires Understanding How Data Shapes Structure and Generalisation","created":"2025-02-08","cited_by_count":17},{"id":"2406.04879","title":"A Deep Dive into the Trade-Offs of Parameter-Efficient Preference Alignment Techniques","created":"2024-06-07","cited_by_count":16},{"id":"2507.10616","title":"Scalpel vs. Hammer: GRPO Amplifies Existing Capabilities, SFT Replaces Them","created":"2025-07-13","cited_by_count":15},{"id":"2508.18312","title":"What Matters in Data for DPO?","created":"2025-08-23","cited_by_count":12},{"id":"2506.06166","title":"The Lock-in Hypothesis: Stagnation by Algorithm","created":"2025-06-06","cited_by_count":11},{"id":"2506.07326","title":"Reward Model Interpretability via Optimal and Pessimal Tokens","created":"2025-06-08","cited_by_count":10},{"id":"2502.16825","title":"Finding the Sweet Spot: Preference Data Construction for Scaling Preference Optimization","created":"2025-02-24","cited_by_count":9},{"id":"2502.11284","title":"Balancing the Budget: Understanding Trade-offs Between Supervised and Preference-Based Finetuning","created":"2025-02-16","cited_by_count":4}],"next_cursor":null}