{"list":"other","total":114,"rows":[{"id":"1707.06347","title":"Proximal Policy Optimization Algorithms","created":"2017-07-20","cited_by_count":15215},{"id":"2407.21783","title":"The Llama 3 Herd of Models","created":"2024-07-31","cited_by_count":14715},{"id":"2110.14168","title":"Training Verifiers to Solve Math Word Problems","created":"2021-10-27","cited_by_count":10109},{"id":"2402.03300","title":"DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Models","created":"2024-02-05","cited_by_count":9379},{"id":"2306.05685","title":"Judging LLM-as-a-Judge with MT-Bench and Chatbot Arena","created":"2023-06-09","cited_by_count":8626},{"id":"2305.18290","title":"Direct Preference Optimization: Your Language Model is Secretly a Reward Model","created":"2023-05-29","cited_by_count":8065},{"id":"2501.12948","title":"DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learning","created":"2025-01-22","cited_by_count":6330},{"id":"2103.03874","title":"Measuring Mathematical Problem Solving With the MATH Dataset","created":"2021-03-05","cited_by_count":5371},{"id":"1706.03741","title":"Deep reinforcement learning from human preferences","created":"2017-06-12","cited_by_count":3912},{"id":"2204.05862","title":"Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedback","created":"2022-04-12","cited_by_count":3720},{"id":"2109.07958","title":"TruthfulQA: Measuring How Models Mimic Human Falsehoods","created":"2021-09-08","cited_by_count":2975},{"id":"2311.12022","title":"GPQA: A Graduate-Level Google-Proof Q&A Benchmark","created":"2023-11-20","cited_by_count":2879},{"id":"2303.18223","title":"A Survey of Large Language Models","created":"2023-03-31","cited_by_count":2576},{"id":"2406.01574","title":"MMLU-Pro: A More Robust and Challenging Multi-Task Language Understanding Benchmark","created":"2024-06-03","cited_by_count":1848},{"id":"2210.09261","title":"Challenging BIG-Bench Tasks and Whether Chain-of-Thought Can Solve Them","created":"2022-10-17","cited_by_count":1807},{"id":"2305.01210","title":"Is Your Code Generated by ChatGPT Really Correct? Rigorous Evaluation of Large Language Models for Code Generation","created":"2023-05-02","cited_by_count":1391},{"id":"2307.03109","title":"A Survey on Evaluation of Large Language Models","created":"2023-07-06","cited_by_count":1242},{"id":"2311.07911","title":"Instruction-Following Evaluation for Large Language Models","created":"2023-11-14","cited_by_count":1228},{"id":"2401.14196","title":"DeepSeek-Coder: When the Large Language Model Meets Programming -- The Rise of Code Intelligence","created":"2024-01-25","cited_by_count":1181},{"id":"2306.13549","title":"A Survey on Multimodal Large Language Models","created":"2023-06-23","cited_by_count":909},{"id":"2404.04475","title":"Length-Controlled AlpacaEval: A Simple Way to Debias Automatic Evaluators","created":"2024-04-06","cited_by_count":897},{"id":"2307.04657","title":"BeaverTails: Towards Improved Safety Alignment of LLM via a Human-Preference Dataset","created":"2023-07-10","cited_by_count":860},{"id":"2304.00685","title":"Vision-Language Models for Vision Tasks: A Survey","created":"2023-04-03","cited_by_count":839},{"id":"2305.14233","title":"Enhancing Chat Language Models by Scaling High-quality Instructional Conversations","created":"2023-05-23","cited_by_count":839},{"id":"2311.12908","title":"Diffusion Model Alignment Using Direct Preference Optimization","created":"2023-11-21","cited_by_count":790},{"id":"2307.15217","title":"Open Problems and Fundamental Limitations of Reinforcement Learning from Human Feedback","created":"2023-07-27","cited_by_count":759},{"id":"2209.07858","title":"Red Teaming Language Models to Reduce Harms: Methods, Scaling Behaviors, and Lessons Learned","created":"2022-08-23","cited_by_count":729},{"id":"2309.01219","title":"Siren's Song in the AI Ocean: A Survey on Hallucination in Large Language Models","created":"2023-09-03","cited_by_count":698},{"id":"2401.10020","title":"Self-Rewarding Language Models","created":"2024-01-18","cited_by_count":681},{"id":"2307.06435","title":"A Comprehensive Overview of Large Language Models","created":"2023-07-12","cited_by_count":648},{"id":"2309.00770","title":"Bias and Fairness in Large Language Models: A Survey","created":"2023-09-02","cited_by_count":639},{"id":"2401.01335","title":"Self-Play Fine-Tuning Converts Weak Language Models to Strong Language Models","created":"2024-01-02","cited_by_count":557},{"id":"2402.06196","title":"Large Language Models: A Survey","created":"2024-02-09","cited_by_count":525},{"id":"2304.05302","title":"RRHF: Rank Responses to Align Language Models with Human Feedback without tears","created":"2023-04-11","cited_by_count":463},{"id":"2305.10425","title":"SLiC-HF: Sequence Likelihood Calibration with Human Feedback","created":"2023-05-17","cited_by_count":401},{"id":"2308.05374","title":"Trustworthy LLMs: a Survey and Guideline for Evaluating Large Language Models' Alignment","created":"2023-08-10","cited_by_count":401},{"id":"2312.11456","title":"Iterative Preference Learning from Human Feedback: Bridging Theory and Practice for RLHF under KL-Constraint","created":"2023-12-18","cited_by_count":350},{"id":"2110.08420","title":"Understanding Dataset Difficulty with $\\mathcal{V}$-Usable Information","created":"2021-10-16","cited_by_count":291},{"id":"2310.03716","title":"A Long Way to Go: Investigating Length Correlations in RLHF","created":"2023-10-05","cited_by_count":291},{"id":"2401.13601","title":"MM-LLMs: Recent Advances in MultiModal Large Language Models","created":"2024-01-24","cited_by_count":278},{"id":"2406.18629","title":"Step-DPO: Step-wise Preference Optimization for Long-chain Reasoning of LLMs","created":"2024-06-26","cited_by_count":273},{"id":"2312.14925","title":"A Survey of Reinforcement Learning from Human Feedback","created":"2023-12-22","cited_by_count":264},{"id":"2310.19852","title":"AI Alignment: A Comprehensive Survey","created":"2023-10-30","cited_by_count":263},{"id":"2406.15513","title":"PKU-SafeRLHF: Towards Multi-Level Safety Alignment for LLMs with Human Preference","created":"2024-06-20","cited_by_count":261},{"id":"2311.13231","title":"Using Human Feedback to Fine-tune Diffusion Models without Any Reward Model","created":"2023-11-22","cited_by_count":252},{"id":"2309.07430","title":"Adapted Large Language Models Can Outperform Medical Experts in Clinical Text Summarization","created":"2023-09-14","cited_by_count":246},{"id":"2404.19733","title":"Iterative Reasoning Preference Optimization","created":"2024-04-30","cited_by_count":246},{"id":"2405.00451","title":"Monte Carlo Tree Search Boosts Reasoning via Iterative Preference Learning","created":"2024-05-01","cited_by_count":241},{"id":"2405.00675","title":"Self-Play Preference Optimization for Language Model Alignment","created":"2024-05-01","cited_by_count":232},{"id":"2312.00886","title":"Nash Learning from Human Feedback","created":"2023-12-01","cited_by_count":224},{"id":"2306.09265","title":"LVLM-eHub: A Comprehensive Evaluation Benchmark for Large Vision-Language Models","created":"2023-06-15","cited_by_count":217},{"id":"2408.07199","title":"Agent Q: Advanced Reasoning and Learning for Autonomous AI Agents","created":"2024-08-13","cited_by_count":208},{"id":"2310.16049","title":"MuSR: Testing the Limits of Chain-of-thought with Multistep Soft Reasoning","created":"2023-10-24","cited_by_count":201},{"id":"2404.09932","title":"Foundational Challenges in Assuring Alignment and Safety of Large Language Models","created":"2024-04-15","cited_by_count":199},{"id":"2403.02502","title":"Trial and Error: Exploration-Based Trajectory Optimization for LLM Agents","created":"2024-03-04","cited_by_count":197},{"id":"2404.02078","title":"Advancing LLM Reasoning Generalists with Preference Trees","created":"2024-04-02","cited_by_count":192},{"id":"2310.10505","title":"ReMax: A Simple, Effective, and Efficient Reinforcement Learning Method for Aligning Large Language Models","created":"2023-10-16","cited_by_count":187},{"id":"2401.01967","title":"A Mechanistic Understanding of Alignment Algorithms: A Case Study on DPO and Toxicity","created":"2024-01-03","cited_by_count":185},{"id":"2404.14367","title":"Preference Fine-Tuning of LLMs Should Leverage Suboptimal, On-Policy Data","created":"2024-04-22","cited_by_count":185},{"id":"2404.03715","title":"Direct Nash Optimization: Teaching Language Models to Self-Improve with General Preferences","created":"2024-04-04","cited_by_count":178},{"id":"2402.18013","title":"A Survey on Recent Advances in LLM-Based Multi-turn Dialogue Systems","created":"2024-02-28","cited_by_count":170},{"id":"2404.01258","title":"Direct Preference Optimization of Video Large Multimodal Models from Language Model Reward","created":"2024-04-01","cited_by_count":147},{"id":"2401.04056","title":"A Minimaximalist Approach to Reinforcement Learning from Human Feedback","created":"2024-01-08","cited_by_count":144},{"id":"2311.09528","title":"HelpSteer: Multi-attribute Helpfulness Dataset for SteerLM","created":"2023-11-16","cited_by_count":142},{"id":"2404.18922","title":"DPO Meets PPO: Reinforced Token Optimization for RLHF","created":"2024-04-29","cited_by_count":127},{"id":"2303.06689","title":"Self-planning Code Generation with Large Language Models","created":"2023-03-12","cited_by_count":124},{"id":"2404.04465","title":"Aligning Diffusion Models by Optimizing Human Utility","created":"2024-04-06","cited_by_count":101},{"id":"2404.09956","title":"Tango 2: Aligning Diffusion-based Text-to-Audio Generations through Direct Preference Optimization","created":"2024-04-15","cited_by_count":97},{"id":"2406.09136","title":"Chain of Preference Optimization: Improving Chain-of-Thought Reasoning in LLMs","created":"2024-06-13","cited_by_count":96},{"id":"2405.20304","title":"Group Robust Preference Optimization in Reward-free RLHF","created":"2024-05-30","cited_by_count":95},{"id":"2305.11391","title":"A Survey of Safety and Trustworthiness of Large Language Models through the Lens of Verification and Validation","created":"2023-05-19","cited_by_count":93},{"id":"2407.16216","title":"Reinforcement Learning for LLM Post-Training: A Survey","created":"2024-07-23","cited_by_count":92},{"id":"2405.19320","title":"Value-Incentivized Preference Optimization: A Unified Approach to Online and Offline RLHF","created":"2024-05-29","cited_by_count":73},{"id":"2406.10858","title":"Step-level Value Preference Optimization for Mathematical Reasoning","created":"2024-06-16","cited_by_count":72},{"id":"2411.02712","title":"V-DPO: Mitigating Hallucination in Large Vision Language Models via Vision-Guided Direct Preference Optimization","created":"2024-11-05","cited_by_count":67},{"id":"2409.02392","title":"Building Math Agents with Multi-Turn Iterative Preference Learning","created":"2024-09-04","cited_by_count":66},{"id":"2406.09215","title":"On Softmax Direct Preference Optimization for Recommendation","created":"2024-06-13","cited_by_count":64},{"id":"2402.10500","title":"Active Preference Optimization for Sample Efficient RLHF","created":"2024-02-16","cited_by_count":62},{"id":"2305.00955","title":"Bridging the Gap: A Survey on Integrating (Human) Feedback for Natural Language Generation","created":"2023-05-01","cited_by_count":55},{"id":"2402.08265","title":"A Dense Reward View on Aligning Text-to-Image Diffusion with Preference","created":"2024-02-13","cited_by_count":55},{"id":"2310.07629","title":"The Past, Present and Better Future of Feedback Learning in Large Language Models for Subjective Human Preferences and Values","created":"2023-10-11","cited_by_count":54},{"id":"2311.16153","title":"Identifying and Mitigating Vulnerabilities in LLM-Integrated Applications","created":"2023-11-07","cited_by_count":54},{"id":"2406.17744","title":"Following Length Constraints in Instructions","created":"2024-06-25","cited_by_count":46},{"id":"2402.09401","title":"Reinforcement Learning from Human Feedback with Active Queries","created":"2024-02-14","cited_by_count":43},{"id":"2312.10584","title":"Policy Optimization in RLHF: The Impact of Out-of-preference Data","created":"2023-12-17","cited_by_count":35},{"id":"2407.00782","title":"Step-Controlled DPO: Leveraging Stepwise Error for Enhanced Mathematical Reasoning","created":"2024-06-30","cited_by_count":35},{"id":"2409.07253","title":"Alignment of Diffusion Models: Fundamentals, Challenges, and Future","created":"2024-09-11","cited_by_count":35},{"id":"2410.12735","title":"CREAM: Consistency Regularized Self-Rewarding Language Models","created":"2024-10-16","cited_by_count":35},{"id":"2410.05605","title":"CodeDPO: Aligning Code Models with Self Generated and Verified Source Code","created":"2024-10-08","cited_by_count":34},{"id":"2406.06382","title":"Diffusion-RPO: Aligning Diffusion Models through Relative Preference Optimization","created":"2024-06-10","cited_by_count":32},{"id":"2409.14586","title":"Backtracking Improves Generation Safety","created":"2024-09-22","cited_by_count":32},{"id":"2501.16629","title":"CHiP: Cross-modal Hierarchical Direct Preference Optimization for Multimodal LLMs","created":"2025-01-28","cited_by_count":31},{"id":"2408.16090","title":"EPO: Hierarchical LLM Agents with Environment Preference Optimization","created":"2024-08-28","cited_by_count":28},{"id":"2501.06521","title":"Fine-tuning Large Language Models for Improving Factuality in Legal Question Answering","created":"2025-01-11","cited_by_count":28},{"id":"2403.01857","title":"Reward Model Learning vs. Direct Policy Optimization: A Comparative Analysis of Learning from Human Preferences","created":"2024-03-04","cited_by_count":27},{"id":"2402.10884","title":"Multi-modal Preference Alignment Remedies Degradation of Visual Instruction Tuning on Language Models","created":"2024-02-16","cited_by_count":26},{"id":"2407.18248","title":"Self-Training with Direct Preference Optimization Improves Chain-of-Thought Reasoning","created":"2024-07-25","cited_by_count":26},{"id":"2406.11191","title":"A Survey on Human Preference Learning for Large Language Models","created":"2024-06-17","cited_by_count":24},{"id":"2311.16789","title":"A Survey of the Evolution of Language Model-Based Dialogue Systems: Data, Task and Models","created":"2023-11-28","cited_by_count":23},{"id":"2407.02477","title":"Understanding Alignment in Multimodal LLMs: A Comprehensive Study","created":"2024-07-02","cited_by_count":23}],"next_cursor":"100"}