{"list":"other","total":113,"rows":[{"id":"2005.14165","title":"Language Models are Few-Shot Learners","created":"2020-05-28","cited_by_count":32419},{"id":"2203.02155","title":"Training language models to follow instructions with human feedback","created":"2022-03-04","cited_by_count":15971},{"id":"1707.06347","title":"Proximal Policy Optimization Algorithms","created":"2017-07-20","cited_by_count":15215},{"id":"2402.03300","title":"DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Models","created":"2024-02-05","cited_by_count":9379},{"id":"2306.05685","title":"Judging LLM-as-a-Judge with MT-Bench and Chatbot Arena","created":"2023-06-09","cited_by_count":8626},{"id":"2305.18290","title":"Direct Preference Optimization: Your Language Model is Secretly a Reward Model","created":"2023-05-29","cited_by_count":8065},{"id":"2001.08361","title":"Scaling Laws for Neural Language Models","created":"2020-01-23","cited_by_count":6586},{"id":"2101.03961","title":"Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsity","created":"2021-01-11","cited_by_count":3073},{"id":"2210.11416","title":"Scaling Instruction-Finetuned Language Models","created":"2022-10-20","cited_by_count":3024},{"id":"2503.14476","title":"DAPO: An Open-Source LLM Reinforcement Learning System at Scale","created":"2025-03-18","cited_by_count":2810},{"id":"2009.01325","title":"Learning to summarize from human feedback","created":"2020-09-02","cited_by_count":2588},{"id":"2303.16634","title":"G-Eval: NLG Evaluation using GPT-4 with Better Human Alignment","created":"2023-03-29","cited_by_count":2276},{"id":"2305.14325","title":"Improving Factuality and Reasoning in Language Models through Multiagent Debate","created":"2023-05-23","cited_by_count":1784},{"id":"2503.20783","title":"Understanding R1-Zero-Like Training: A Critical Perspective","created":"2025-03-26","cited_by_count":1345},{"id":"2305.17926","title":"Large Language Models are not Fair Evaluators","created":"2023-05-29","cited_by_count":1085},{"id":"2405.14734","title":"SimPO: Simple Preference Optimization with a Reference-Free Reward","created":"2024-05-23","cited_by_count":963},{"id":"2312.08935","title":"Math-Shepherd: Verify and Reinforce LLMs Step-by-step without Human Annotations","created":"2023-12-14","cited_by_count":928},{"id":"2310.12036","title":"A General Theoretical Paradigm to Understand Learning from Human Preferences","created":"2023-10-18","cited_by_count":912},{"id":"2307.15217","title":"Open Problems and Fundamental Limitations of Reinforcement Learning from Human Feedback","created":"2023-07-27","cited_by_count":759},{"id":"2401.10020","title":"Self-Rewarding Language Models","created":"2024-01-18","cited_by_count":681},{"id":"2310.12773","title":"Safe RLHF: Safe Reinforcement Learning from Human Feedback","created":"2023-10-19","cited_by_count":656},{"id":"2309.00267","title":"RLAIF vs. RLHF: Scaling Reinforcement Learning from Human Feedback with AI Feedback","created":"2023-09-01","cited_by_count":625},{"id":"2403.07691","title":"ORPO: Monolithic Preference Optimization without Reference Model","created":"2024-03-12","cited_by_count":562},{"id":"2401.01335","title":"Self-Play Fine-Tuning Converts Weak Language Models to Strong Language Models","created":"2024-01-02","cited_by_count":557},{"id":"2402.06196","title":"Large Language Models: A Survey","created":"2024-02-09","cited_by_count":525},{"id":"2411.16594","title":"From Generation to Judgment: Opportunities and Challenges of LLM-as-a-judge","created":"2024-11-25","cited_by_count":494},{"id":"2408.15240","title":"Generative Verifiers: Reward Modeling as Next-Token Prediction","created":"2024-08-27","cited_by_count":480},{"id":"2412.05579","title":"LLMs-as-Judges: A Comprehensive Survey on LLM-based Evaluation Methods","created":"2024-12-07","cited_by_count":465},{"id":"2304.05302","title":"RRHF: Rank Responses to Align Language Models with Human Feedback without tears","created":"2023-04-11","cited_by_count":463},{"id":"2405.01535","title":"Prometheus 2: An Open Source Language Model Specialized in Evaluating Other Language Models","created":"2024-05-02","cited_by_count":446},{"id":"2406.06592","title":"Improve Mathematical Reasoning in Language Models by Automated Process Supervision","created":"2024-06-05","cited_by_count":441},{"id":"2302.14520","title":"Large Language Models Are State-of-the-Art Evaluators of Translation Quality","created":"2023-02-28","cited_by_count":420},{"id":"2305.10425","title":"SLiC-HF: Sequence Likelihood Calibration with Human Feedback","created":"2023-05-17","cited_by_count":401},{"id":"2306.01693","title":"Fine-Grained Human Feedback Gives Better Rewards for Language Model Training","created":"2023-06-02","cited_by_count":401},{"id":"2310.06452","title":"Understanding the Effects of RLHF on LLM Generalisation and Diversity","created":"2023-10-10","cited_by_count":396},{"id":"2312.11456","title":"Iterative Preference Learning from Human Feedback: Bridging Theory and Practice for RLHF under KL-Constraint","created":"2023-12-18","cited_by_count":350},{"id":"2305.03047","title":"Principle-Driven Self-Alignment of Language Models from Scratch with Minimal Human Supervision","created":"2023-05-04","cited_by_count":318},{"id":"2306.17492","title":"Preference Ranking Optimization for Human Alignment","created":"2023-06-30","cited_by_count":285},{"id":"2310.11564","title":"Personalized Soups: Personalized Large Language Model Alignment via Post-hoc Parameter Merging","created":"2023-10-17","cited_by_count":280},{"id":"2310.19852","title":"AI Alignment: A Comprehensive Survey","created":"2023-10-30","cited_by_count":263},{"id":"2410.21819","title":"Self-Preference Bias in LLM-as-a-Judge","created":"2024-10-29","cited_by_count":258},{"id":"2402.16827","title":"A Survey on Data Selection for Language Models","created":"2024-02-26","cited_by_count":236},{"id":"2406.08673","title":"HelpSteer2: Open-source dataset for training top-performing reward models","created":"2024-06-12","cited_by_count":236},{"id":"2405.00675","title":"Self-Play Preference Optimization for Language Model Alignment","created":"2024-05-01","cited_by_count":232},{"id":"2310.10505","title":"ReMax: A Simple, Effective, and Efficient Reinforcement Learning Method for Aligning Large Language Models","created":"2023-10-16","cited_by_count":187},{"id":"2309.06256","title":"Mitigating the Alignment Tax of RLHF","created":"2023-09-12","cited_by_count":183},{"id":"2407.01492","title":"RegMix: Data Mixture as Regression for Language Model Pre-training","created":"2024-07-01","cited_by_count":177},{"id":"2402.05749","title":"Generalized Preference Optimization: A Unified Approach to Offline Alignment","created":"2024-02-08","cited_by_count":157},{"id":"2311.09528","title":"HelpSteer: Multi-attribute Helpfulness Dataset for SteerLM","created":"2023-11-16","cited_by_count":142},{"id":"2404.11999","title":"Token-level Direct Preference Optimization","created":"2024-04-18","cited_by_count":135},{"id":"2510.07743","title":"OpenRubrics: Towards Scalable Synthetic Rubric Generation for Reward Modeling and LLM Alignment","created":"2025-10-09","cited_by_count":132},{"id":"2310.05344","title":"SteerLM: Attribute Conditioned SFT as an (User-Steerable) Alternative to RLHF","created":"2023-10-09","cited_by_count":111},{"id":"2510.01171","title":"Verbalized Sampling: How to Mitigate Mode Collapse and Unlock LLM Diversity","created":"2025-10-01","cited_by_count":105},{"id":"2402.01878","title":"LiPO: Listwise Preference Optimization through Learning-to-Rank","created":"2024-02-02","cited_by_count":96},{"id":"2405.20304","title":"Group Robust Preference Optimization in Reward-free RLHF","created":"2024-05-30","cited_by_count":95},{"id":"2510.24684","title":"SPICE: Self-Play In Corpus Environments Improves Reasoning","created":"2025-10-28","cited_by_count":83},{"id":"2402.06627","title":"Feedback Loops With Language Models Drive In-Context Reward Hacking","created":"2024-02-09","cited_by_count":77},{"id":"2402.18041","title":"Datasets for Large Language Models: A Comprehensive Survey","created":"2024-02-28","cited_by_count":71},{"id":"2411.16646","title":"Self-Generated Critiques Boost Reward Modeling for Language Models","created":"2024-11-25","cited_by_count":71},{"id":"2405.19332","title":"Self-Exploring Language Models: Active Preference Elicitation for Online Alignment","created":"2024-05-29","cited_by_count":63},{"id":"2402.08114","title":"Active Preference Learning for Large Language Models","created":"2024-02-12","cited_by_count":58},{"id":"2411.04427","title":"One fish, two fish, but not the whole sea: Alignment reduces language models' conceptual diversity","created":"2024-11-07","cited_by_count":58},{"id":"2406.11827","title":"WPO: Enhancing RLHF with Weighted Preference Optimization","created":"2024-06-17","cited_by_count":54},{"id":"2501.18101","title":"Diverse Preference Optimization","created":"2025-01-30","cited_by_count":52},{"id":"2402.10038","title":"RS-DPO: A Hybrid Rejection Sampling and Direct Preference Optimization Method for Alignment of Large Language Models","created":"2024-02-15","cited_by_count":48},{"id":"2403.19270","title":"sDPO: Don't Use Your Data All at Once","created":"2024-03-28","cited_by_count":46},{"id":"2404.04656","title":"Binary Classifier Optimization for Large Language Model Alignment","created":"2024-04-06","cited_by_count":45},{"id":"2410.04350","title":"TIS-DPO: Token-level Importance Sampling for Direct Preference Optimization With Estimated Weights","created":"2024-10-06","cited_by_count":42},{"id":"2502.06737","title":"VersaPRM: Multi-Domain Process Reward Model via Synthetic Reasoning Data","created":"2025-02-10","cited_by_count":40},{"id":"2503.17126","title":"Modifying Large Language Model Post-Training for Diverse Creative Writing","created":"2025-03-21","cited_by_count":40},{"id":"2510.08049","title":"A Survey of Process Reward Models: From Outcome Signals to Process Supervisions for Large Language Models","created":"2025-10-09","cited_by_count":38},{"id":"2503.11701","title":"A Survey of Direct Preference Optimization","created":"2025-03-12","cited_by_count":36},{"id":"2506.23235","title":"Generalist Reward Models: Found Inside Large Language Models","created":"2025-06-29","cited_by_count":34},{"id":"2507.23751","title":"CoT-Self-Instruct: Building high-quality synthetic prompts for reasoning and non-reasoning tasks","created":"2025-07-31","cited_by_count":32},{"id":"2404.15045","title":"Multi-Head Mixture-of-Experts","created":"2024-04-23","cited_by_count":31},{"id":"2507.21028","title":"Multi-Agent-as-Judge: Aligning LLM-Agent-Based Automated Evaluation with Multi-Dimensional Human Evaluation","created":"2025-07-28","cited_by_count":30},{"id":"2410.10148","title":"AlphaDPO: Adaptive Reward Margin for Direct Preference Optimization","created":"2024-10-14","cited_by_count":29},{"id":"2410.15595","title":"A Comprehensive Survey of Direct Preference Optimization: Datasets, Theories, Variants, and Applications","created":"2024-10-21","cited_by_count":27},{"id":"2501.12735","title":"Online Preference Alignment for Language Models via Count-based Exploration","created":"2025-01-22","cited_by_count":26},{"id":"2505.14442","title":"Creative Preference Optimization","created":"2025-05-20","cited_by_count":25},{"id":"2410.13116","title":"Learning to Summarize from LLM-generated Feedback","created":"2024-10-17","cited_by_count":24},{"id":"2503.21819","title":"Optimizing Safe and Aligned Language Generation: A Multi-Objective GRPO Approach","created":"2025-03-26","cited_by_count":24},{"id":"2504.14716","title":"Pairwise or Pointwise? Evaluating Feedback Protocols for Bias in LLM-Based Evaluation","created":"2025-04-20","cited_by_count":24},{"id":"2505.20686","title":"Accelerating RL for LLM Reasoning with Optimal Advantage Regression","created":"2025-05-27","cited_by_count":24},{"id":"2507.01915","title":"Gradient-Adaptive Policy Optimization: Towards Multi-Objective Alignment of Large Language Models","created":"2025-07-02","cited_by_count":23},{"id":"2502.11555","title":"Equilibrate RLHF: Towards Balancing Helpfulness-Safety Trade-off in Large Language Models","created":"2025-02-17","cited_by_count":22},{"id":"2503.00295","title":"Robust Multi-Objective Preference Alignment with Online DPO","created":"2025-03-01","cited_by_count":22},{"id":"2405.12739","title":"SPO: Multi-Dimensional Preference Sequential Alignment With Implicit Reward Modeling","created":"2024-05-21","cited_by_count":21},{"id":"2410.16708","title":"Atomic Fact Decomposition Helps Attributed Question Answering","created":"2024-10-22","cited_by_count":21},{"id":"2412.05469","title":"Multi-Objective Alignment of Large Language Models Through Hypervolume Maximization","created":"2024-12-06","cited_by_count":20},{"id":"2508.07768","title":"Pareto Multi-Objective Alignment for Language Models","created":"2025-08-11","cited_by_count":20},{"id":"2311.13246","title":"CoachLM: Automatic Instruction Revisions Improve the Data Quality in LLM Instruction Tuning","created":"2023-11-22","cited_by_count":19},{"id":"2504.14194","title":"Meta-rater: A Multi-dimensional Data Selection Method for Pre-training Language Models","created":"2025-04-19","cited_by_count":19},{"id":"2312.01700","title":"Data Management For Training Large Language Models: A Survey","created":"2023-12-04","cited_by_count":17},{"id":"2410.03145","title":"Margin Matching Preference Optimization: Enhanced Model Alignment with Granular Feedback","created":"2024-10-04","cited_by_count":15},{"id":"2412.03187","title":"Weighted-Reward Preference Optimization for Implicit Model Fusion","created":"2024-12-04","cited_by_count":15},{"id":"2505.10892","title":"Multi-Objective Preference Optimization: Improving Human Alignment of Generative Models","created":"2025-05-16","cited_by_count":13},{"id":"2503.01864","title":"Larger or Smaller Reward Margins to Select Preferences for Alignment?","created":"2025-02-25","cited_by_count":11},{"id":"2506.00549","title":"Towards Multi-dimensional Evaluation of LLM Summarization across Domains and Languages","created":"2025-05-31","cited_by_count":11},{"id":"2405.16388","title":"Multi-Reference Preference Optimization for Large Language Models","created":"2024-05-26","cited_by_count":10}],"next_cursor":"100"}