{"list":"other","total":184,"rows":[{"id":"2203.02155","title":"Training language models to follow instructions with human feedback","created":"2022-03-04","cited_by_count":15971},{"id":"2201.11903","title":"Chain-of-Thought Prompting Elicits Reasoning in Large Language Models","created":"2022-01-28","cited_by_count":12459},{"id":"2110.14168","title":"Training Verifiers to Solve Math Word Problems","created":"2021-10-27","cited_by_count":10109},{"id":"2402.03300","title":"DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Models","created":"2024-02-05","cited_by_count":9379},{"id":"2203.11171","title":"Self-Consistency Improves Chain of Thought Reasoning in Language Models","created":"2022-03-21","cited_by_count":5708},{"id":"2303.11366","title":"Reflexion: Language Agents with Verbal Reinforcement Learning","created":"2023-03-20","cited_by_count":4276},{"id":"2204.05862","title":"Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedback","created":"2022-04-12","cited_by_count":3720},{"id":"2303.17651","title":"Self-Refine: Iterative Refinement with Self-Feedback","created":"2023-03-30","cited_by_count":3442},{"id":"2203.15556","title":"Training Compute-Optimal Large Language Models","created":"2022-03-29","cited_by_count":3019},{"id":"2303.12712","title":"Sparks of Artificial General Intelligence: Early experiments with GPT-4","created":"2023-03-22","cited_by_count":2592},{"id":"2408.03314","title":"Scaling LLM Test-Time Compute Optimally can be More Effective than Scaling Model Parameters","created":"2024-08-06","cited_by_count":1986},{"id":"1606.06565","title":"Concrete Problems in AI Safety","created":"2016-06-21","cited_by_count":1642},{"id":"2411.15594","title":"A Survey on LLM-as-a-Judge","created":"2024-11-23","cited_by_count":1423},{"id":"2206.14858","title":"Solving Quantitative Reasoning Problems with Language Models","created":"2022-06-29","cited_by_count":1392},{"id":"2412.16720","title":"OpenAI o1 System Card","created":"2024-12-21","cited_by_count":1244},{"id":"2304.05977","title":"ImageReward: Learning and Evaluating Human Preferences for Text-to-Image Generation","created":"2023-04-12","cited_by_count":1045},{"id":"2310.13548","title":"Towards Understanding Sycophancy in Language Models","created":"2023-10-20","cited_by_count":1040},{"id":"2310.01798","title":"Large Language Models Cannot Self-Correct Reasoning Yet","created":"2023-10-03","cited_by_count":1017},{"id":"2407.21787","title":"Large Language Monkeys: Scaling Inference Compute with Repeated Sampling","created":"2024-07-31","cited_by_count":991},{"id":"2304.05128","title":"Teaching Large Language Models to Self-Debug","created":"2023-04-11","cited_by_count":988},{"id":"2305.01569","title":"Pick-a-Pic: An Open Dataset of User Preferences for Text-to-Image Generation","created":"2023-05-02","cited_by_count":977},{"id":"2203.14465","title":"STaR: Bootstrapping Reasoning With Reasoning","created":"2022-03-28","cited_by_count":940},{"id":"2507.18071","title":"Group Sequence Policy Optimization","created":"2025-07-24","cited_by_count":835},{"id":"2305.11738","title":"CRITIC: Large Language Models Can Self-Correct with Tool-Interactive Critiquing","created":"2023-05-19","cited_by_count":783},{"id":"2401.10020","title":"Self-Rewarding Language Models","created":"2024-01-18","cited_by_count":681},{"id":"2309.00267","title":"RLAIF vs. RLHF: Scaling Reinforcement Learning from Human Feedback with AI Feedback","created":"2023-09-01","cited_by_count":625},{"id":"2310.04406","title":"Language Agent Tree Search Unifies Reasoning Acting and Planning in Language Models","created":"2023-10-06","cited_by_count":574},{"id":"2306.02561","title":"LLM-Blender: Ensembling Large Language Models with Pairwise Ranking and Generative Fusion","created":"2023-06-05","cited_by_count":564},{"id":"2308.08998","title":"Reinforced Self-Training (ReST) for Language Modeling","created":"2023-08-17","cited_by_count":500},{"id":"2403.13787","title":"RewardBench: Evaluating Reward Models for Language Modeling","created":"2024-03-20","cited_by_count":499},{"id":"2412.05579","title":"LLMs-as-Judges: A Comprehensive Survey on LLM-based Evaluation Methods","created":"2024-12-07","cited_by_count":465},{"id":"2304.05302","title":"RRHF: Rank Responses to Align Language Models with Human Feedback without tears","created":"2023-04-11","cited_by_count":463},{"id":"2308.01825","title":"Scaling Relationship on Learning Mathematical Reasoning with Large Language Models","created":"2023-08-03","cited_by_count":427},{"id":"2409.12917","title":"Training Language Models to Self-Correct via Reinforcement Learning","created":"2024-09-19","cited_by_count":426},{"id":"2403.17297","title":"InternLM2 Technical Report","created":"2024-03-26","cited_by_count":397},{"id":"2503.11926","title":"Monitoring Reasoning Models for Misbehavior and the Risks of Promoting Obfuscation","created":"2025-03-14","cited_by_count":384},{"id":"2406.12845","title":"Interpretable Preferences via Multi-Objective Reward Modeling and Mixture-of-Experts","created":"2024-06-18","cited_by_count":376},{"id":"2502.17419","title":"From System 1 to System 2: A Survey of Reasoning Large Language Models","created":"2025-02-24","cited_by_count":320},{"id":"2410.12784","title":"JudgeBench: A Benchmark for Evaluating LLM-based Judges","created":"2024-10-16","cited_by_count":318},{"id":"2501.04519","title":"rStar-Math: Small LLMs Can Master Math Reasoning with Self-Evolved Deep Thinking","created":"2025-01-08","cited_by_count":313},{"id":"2309.17179","title":"Alphazero-like Tree-Search can Guide Large Language Model Decoding and Training","created":"2023-09-29","cited_by_count":295},{"id":"2501.09686","title":"Towards Large Reasoning Models: A Survey of Reinforced Reasoning with Large Language Models","created":"2025-01-16","cited_by_count":293},{"id":"2310.03716","title":"A Long Way to Go: Investigating Length Correlations in RLHF","created":"2023-10-05","cited_by_count":291},{"id":"2501.13918","title":"Improving Video Generation with Human Feedback","created":"2025-01-23","cited_by_count":284},{"id":"2406.18629","title":"Step-DPO: Step-wise Preference Optimization for Long-chain Reasoning of LLMs","created":"2024-06-26","cited_by_count":273},{"id":"2312.14925","title":"A Survey of Reinforcement Learning from Human Feedback","created":"2023-12-22","cited_by_count":264},{"id":"2404.19733","title":"Iterative Reasoning Preference Optimization","created":"2024-04-30","cited_by_count":246},{"id":"2405.00451","title":"Monte Carlo Tree Search Boosts Reasoning via Iterative Preference Learning","created":"2024-05-01","cited_by_count":241},{"id":"2308.03188","title":"Automatically Correcting Large Language Models: Surveying the landscape of diverse self-correction strategies","created":"2023-08-06","cited_by_count":238},{"id":"2406.08673","title":"HelpSteer2: Open-source dataset for training top-performing reward models","created":"2024-06-12","cited_by_count":236},{"id":"2206.02336","title":"Making Large Language Models Better Reasoners with Step-Aware Verifier","created":"2022-06-06","cited_by_count":233},{"id":"2310.02743","title":"Reward Model Ensembles Help Mitigate Overoptimization","created":"2023-10-04","cited_by_count":231},{"id":"2503.24235","title":"A Survey on Test-Time Scaling in Large Language Models: What, How, Where, and How Well?","created":"2025-03-31","cited_by_count":223},{"id":"2402.06457","title":"V-STaR: Training Verifiers for Self-Taught Reasoners","created":"2024-02-09","cited_by_count":217},{"id":"2209.13085","title":"Defining and Characterizing Reward Hacking","created":"2022-09-27","cited_by_count":203},{"id":"2312.09244","title":"Helping or Herding? Reward Model Ensembles Mitigate but do not Eliminate Reward Hacking","created":"2023-12-14","cited_by_count":200},{"id":"2404.02078","title":"Advancing LLM Reasoning Generalists with Preference Trees","created":"2024-04-02","cited_by_count":192},{"id":"2406.10162","title":"Sycophancy to Subterfuge: Investigating Reward-Tampering in Large Language Models","created":"2024-06-14","cited_by_count":178},{"id":"2410.16184","title":"RM-Bench: Benchmarking Reward Models of Language Models with Subtlety and Style","created":"2024-10-21","cited_by_count":176},{"id":"2401.06080","title":"Secrets of RLHF in Large Language Models Part II: Reward Modeling","created":"2024-01-11","cited_by_count":171},{"id":"2407.18219","title":"Recursive Introspection: Teaching Language Model Agents How to Self-Improve","created":"2024-07-25","cited_by_count":165},{"id":"2412.09413","title":"Imitate, Explore, and Self-Improve: A Reproduction Report on Slow-thinking Reasoning Systems","created":"2024-12-12","cited_by_count":164},{"id":"2308.00436","title":"SelfCheck: Using LLMs to Zero-Shot Check Their Own Step-by-Step Reasoning","created":"2023-08-01","cited_by_count":159},{"id":"2408.10075","title":"Personalizing Reinforcement Learning from Human Feedback with Variational Preference Learning","created":"2024-08-19","cited_by_count":155},{"id":"2506.01937","title":"RewardBench 2: Advancing Reward Model Evaluation","created":"2025-06-02","cited_by_count":150},{"id":"2410.12832","title":"Generative Reward Models","created":"2024-10-02","cited_by_count":148},{"id":"2401.12187","title":"WARM: On the Benefits of Weight Averaged Reward Models","created":"2024-01-22","cited_by_count":147},{"id":"2407.11511","title":"Multi-Step Reasoning with Large Language Models, a Survey","created":"2024-07-16","cited_by_count":143},{"id":"2311.09528","title":"HelpSteer: Multi-attribute Helpfulness Dataset for SteerLM","created":"2023-11-16","cited_by_count":142},{"id":"2406.10216","title":"Regularizing Hidden States Enables Learning Generalizable Reward Model for LLMs","created":"2024-06-14","cited_by_count":142},{"id":"2503.10291","title":"VisualPRM: An Effective Process Reward Model for Multimodal Reasoning","created":"2025-03-13","cited_by_count":139},{"id":"2402.07319","title":"ODIN: Disentangled Reward Mitigates Hacking in RLHF","created":"2024-02-11","cited_by_count":136},{"id":"2406.13743","title":"GenAI-Bench: Evaluating and Improving Compositional Text-to-Visual Generation","created":"2024-06-19","cited_by_count":135},{"id":"2410.01257","title":"HelpSteer2-Preference: Complementing Ratings with Preferences","created":"2024-10-02","cited_by_count":130},{"id":"2409.12822","title":"Language Models Learn to Mislead Humans via RLHF","created":"2024-09-19","cited_by_count":124},{"id":"1908.04734","title":"Reward Tampering Problems and Solutions in Reinforcement Learning: A Causal Influence Diagram Perspective","created":"2019-08-13","cited_by_count":108},{"id":"2402.14740","title":"Back to Basics: Revisiting REINFORCE Style Optimization for Learning from Human Feedback in LLMs","created":"2024-02-22","cited_by_count":108},{"id":"2408.11791","title":"Critique-out-Loud Reward Models","created":"2024-08-21","cited_by_count":106},{"id":"2501.19324","title":"Reward-Guided Speculative Decoding for Efficient LLM Reasoning","created":"2025-01-31","cited_by_count":106},{"id":"2310.20689","title":"Learning From Mistakes Makes LLM Better Reasoner","created":"2023-10-31","cited_by_count":101},{"id":"2411.15287","title":"Sycophancy in Large Language Models: Causes and Mitigations","created":"2024-11-22","cited_by_count":101},{"id":"2406.14283","title":"Q*: Improving Multi-step Reasoning for LLMs with Deliberative Planning","created":"2024-06-20","cited_by_count":97},{"id":"2503.21878","title":"Is Best-of-N the Best of Them? Coverage, Scaling, and Optimality in Inference-Time Alignment","created":"2025-03-27","cited_by_count":97},{"id":"2403.09472","title":"Easy-to-Hard Generalization: Scalable Alignment Beyond Human Supervision","created":"2024-03-14","cited_by_count":96},{"id":"2410.09671","title":"OpenR: An Open Source Framework for Advanced Reasoning with Large Language Models","created":"2024-10-12","cited_by_count":94},{"id":"2505.03318","title":"Unified Multimodal Chain-of-Thought Reward Model through Reinforcement Fine-Tuning","created":"2025-05-06","cited_by_count":90},{"id":"2410.14872","title":"How to Evaluate Reward Models for RLHF","created":"2024-10-18","cited_by_count":88},{"id":"2502.18770","title":"Reward Shaping to Mitigate Reward Hacking in RLHF","created":"2025-02-26","cited_by_count":88},{"id":"2411.17451","title":"VL-RewardBench: A Challenging Benchmark for Vision-Language Generative Reward Models","created":"2024-11-26","cited_by_count":86},{"id":"2502.10391","title":"MM-RLHF: The Next Step Forward in Multimodal LLM Alignment","created":"2025-02-14","cited_by_count":83},{"id":"1803.03453","title":"The Surprising Creativity of Digital Evolution: A Collection of Anecdotes from the Evolutionary Computation and Artificial Life Research Communities","created":"2018-03-09","cited_by_count":78},{"id":"2310.05199","title":"Loose lips sink ships: Mitigating Length Bias in Reinforcement Learning from Human Feedback","created":"2023-10-08","cited_by_count":78},{"id":"2412.00154","title":"o1-Coder: an o1 Replication for Coding","created":"2024-11-29","cited_by_count":78},{"id":"2504.00050","title":"JudgeLRM: Large Reasoning Models as a Judge","created":"2025-03-31","cited_by_count":78},{"id":"2402.06627","title":"Feedback Loops With Language Models Drive In-Context Reward Hacking","created":"2024-02-09","cited_by_count":77},{"id":"2412.15084","title":"AceMath: Advancing Frontier Math Reasoning with Post-Training and Reward Modeling","created":"2024-12-19","cited_by_count":77},{"id":"2505.11475","title":"HelpSteer3-Preference: Open Human-Annotated Preference Data across Diverse Tasks and Languages","created":"2025-05-16","cited_by_count":75},{"id":"2410.00847","title":"Uncertainty-aware Reward Model: Teaching Reward Models to Know What is Unknown","created":"2024-10-01","cited_by_count":74},{"id":"2503.15477","title":"What Makes a Reward Model a Good Teacher? An Optimization Perspective","created":"2025-03-19","cited_by_count":73},{"id":"2502.19613","title":"Self-rewarding correction for mathematical reasoning","created":"2025-02-26","cited_by_count":70}],"next_cursor":"100"}