{"list":"other","total":81,"rows":[{"id":"1707.06347","title":"Proximal Policy Optimization Algorithms","created":"2017-07-20","cited_by_count":15215},{"id":"2407.21783","title":"The Llama 3 Herd of Models","created":"2024-07-31","cited_by_count":14715},{"id":"2307.09288","title":"Llama 2: Open Foundation and Fine-Tuned Chat Models","created":"2023-07-18","cited_by_count":13028},{"id":"2110.14168","title":"Training Verifiers to Solve Math Word Problems","created":"2021-10-27","cited_by_count":10109},{"id":"2402.03300","title":"DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Models","created":"2024-02-05","cited_by_count":9379},{"id":"2107.03374","title":"Evaluating Large Language Models Trained on Code","created":"2021-07-07","cited_by_count":8320},{"id":"2001.08361","title":"Scaling Laws for Neural Language Models","created":"2020-01-23","cited_by_count":6586},{"id":"2204.05862","title":"Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedback","created":"2022-04-12","cited_by_count":3720},{"id":"2212.08073","title":"Constitutional AI: Harmlessness from AI Feedback","created":"2022-12-15","cited_by_count":3050},{"id":"2203.15556","title":"Training Compute-Optimal Large Language Models","created":"2022-03-29","cited_by_count":3019},{"id":"2211.05100","title":"BLOOM: A 176B-Parameter Open-Access Multilingual Language Model","created":"2022-11-09","cited_by_count":1984},{"id":"2401.04088","title":"Mixtral of Experts","created":"2024-01-08","cited_by_count":1823},{"id":"1803.10122","title":"World Models","created":"2018-03-27","cited_by_count":1513},{"id":"2411.15594","title":"A Survey on LLM-as-a-Judge","created":"2024-11-23","cited_by_count":1423},{"id":"2409.12186","title":"Qwen2.5-Coder Technical Report","created":"2024-09-18","cited_by_count":1203},{"id":"2409.12122","title":"Qwen2.5-Math Technical Report: Toward Mathematical Expert Model via Self-Improvement","created":"2024-09-18","cited_by_count":1090},{"id":"2407.21787","title":"Large Language Monkeys: Scaling Inference Compute with Repeated Sampling","created":"2024-07-31","cited_by_count":991},{"id":"2308.10792","title":"Instruction Tuning for Large Language Models: A Survey","created":"2023-08-21","cited_by_count":623},{"id":"1811.07871","title":"Scalable agent alignment via reward modeling: a research direction","created":"2018-11-19","cited_by_count":447},{"id":"2403.17297","title":"InternLM2 Technical Report","created":"2024-03-26","cited_by_count":397},{"id":"2406.03816","title":"ReST-MCTS*: LLM Self-Training via Process Reward Guided Tree Search","created":"2024-06-06","cited_by_count":344},{"id":"2410.08146","title":"Rewarding Progress: Scaling Automated Process Verifiers for LLM Reasoning","created":"2024-10-10","cited_by_count":279},{"id":"2412.03572","title":"Navigation World Models","created":"2024-12-04","cited_by_count":272},{"id":"2404.12358","title":"From $r$ to $Q^*$: Your Language Model is Secretly a Q-Function","created":"2024-04-18","cited_by_count":242},{"id":"2405.00451","title":"Monte Carlo Tree Search Boosts Reasoning via Iterative Preference Learning","created":"2024-05-01","cited_by_count":241},{"id":"2212.09196","title":"Emergent Analogical Reasoning in Large Language Models","created":"2022-12-19","cited_by_count":240},{"id":"2307.04964","title":"Secrets of RLHF in Large Language Models Part I: PPO","created":"2023-07-11","cited_by_count":229},{"id":"2408.07199","title":"Agent Q: Advanced Reasoning and Learning for Autonomous AI Agents","created":"2024-08-13","cited_by_count":208},{"id":"2407.19594","title":"Meta-Rewarding Language Models: Self-Improving Alignment with LLM-as-a-Meta-Judge","created":"2024-07-28","cited_by_count":204},{"id":"2402.08268","title":"World Model on Million-Length Video And Language With Blockwise RingAttention","created":"2024-02-13","cited_by_count":198},{"id":"2411.12372","title":"RedPajama: an Open Dataset for Training Large Language Models","created":"2024-11-19","cited_by_count":182},{"id":"2401.06080","title":"Secrets of RLHF in Large Language Models Part II: Reward Modeling","created":"2024-01-11","cited_by_count":171},{"id":"2405.03553","title":"AlphaMath Almost Zero: Process Supervision without Process","created":"2024-05-06","cited_by_count":162},{"id":"2403.04642","title":"Teaching Large Language Models to Reason with Reinforcement Learning","created":"2024-03-07","cited_by_count":160},{"id":"2406.07394","title":"Accessing GPT-4 level Mathematical Olympiad Solutions via Monte Carlo Tree Self-refine with LLaMa-3 8B","created":"2024-06-11","cited_by_count":158},{"id":"2407.01476","title":"Tree Search for Language Model Agents","created":"2024-07-01","cited_by_count":151},{"id":"2304.09797","title":"Progressive-Hint Prompting Improves Reasoning in Large Language Models","created":"2023-04-19","cited_by_count":147},{"id":"2408.07055","title":"LongWriter: Unleashing 10,000+ Word Generation from Long Context LLMs","created":"2024-08-13","cited_by_count":144},{"id":"2407.11511","title":"Multi-Step Reasoning with Large Language Models, a Survey","created":"2024-07-16","cited_by_count":143},{"id":"2408.06195","title":"Mutual Reasoning Makes Smaller LLMs Stronger Problem-Solvers","created":"2024-08-12","cited_by_count":138},{"id":"2404.18922","title":"DPO Meets PPO: Reinforced Token Optimization for RLHF","created":"2024-04-29","cited_by_count":127},{"id":"2409.12822","title":"Language Models Learn to Mislead Humans via RLHF","created":"2024-09-19","cited_by_count":124},{"id":"2406.00832","title":"BoNBoN Alignment for Large Language Models and the Sweetness of Best-of-n Sampling","created":"2024-06-02","cited_by_count":121},{"id":"2410.20290","title":"Fast Best-of-N Decoding via Speculative Rejection","created":"2024-10-26","cited_by_count":112},{"id":"2310.10080","title":"Let's reward step by step: Step-Level reward model as the Navigators for Reasoning","created":"2023-10-16","cited_by_count":102},{"id":"2410.09671","title":"OpenR: An Open Source Framework for Advanced Reasoning with Large Language Models","created":"2024-10-12","cited_by_count":94},{"id":"2410.02884","title":"LLaMA-Berry: Pairwise Optimization for O1-like Olympiad-Level Mathematical Reasoning","created":"2024-10-03","cited_by_count":91},{"id":"2402.14083","title":"Beyond A*: Better Planning with Transformers via Search Dynamics Bootstrapping","created":"2024-02-21","cited_by_count":90},{"id":"2406.11813","title":"How Do Large Language Models Acquire Factual Knowledge During Pretraining?","created":"2024-06-17","cited_by_count":90},{"id":"2401.09985","title":"WorldDreamer: Towards General World Models for Video Generation via Predicting Masked Tokens","created":"2024-01-18","cited_by_count":89},{"id":"2402.01391","title":"StepCoder: Improve Code Generation with Reinforcement Learning from Compiler Feedback","created":"2024-02-02","cited_by_count":77},{"id":"2407.14622","title":"BOND: Aligning LLMs with Best-of-N Distillation","created":"2024-07-19","cited_by_count":76},{"id":"2406.13542","title":"Self-play with Execution Feedback: Improving Instruction-following Capabilities of Large Language Models","created":"2024-06-19","cited_by_count":73},{"id":"2311.11797","title":"Igniting Language Intelligence: The Hitchhiker's Guide From Chain-of-Thought Reasoning to Language Agents","created":"2023-11-20","cited_by_count":72},{"id":"2402.18041","title":"Datasets for Large Language Models: A Comprehensive Survey","created":"2024-02-28","cited_by_count":71},{"id":"2406.16937","title":"A Complete Survey on LLM-based AI Chatbots","created":"2024-06-17","cited_by_count":71},{"id":"2312.11562","title":"A Survey of Reasoning with Foundation Models","created":"2023-12-17","cited_by_count":70},{"id":"2408.16673","title":"Preserving Diversity in Supervised Fine-Tuning of Large Language Models","created":"2024-08-29","cited_by_count":70},{"id":"2309.15028","title":"Don't throw away your value model! Generating more preferable text with Value-Guided Monte-Carlo Tree Search decoding","created":"2023-09-26","cited_by_count":60},{"id":"2306.02572","title":"Introduction to Latent Variable Energy-Based Models: A Path Towards Autonomous Machine Intelligence","created":"2023-06-05","cited_by_count":56},{"id":"2411.17501","title":"The Limits of Inference Scaling Through Resampling","created":"2024-11-26","cited_by_count":53},{"id":"2407.06057","title":"Variational Best-of-N Alignment","created":"2024-07-08","cited_by_count":51},{"id":"2411.19488","title":"Interleaved-Modal Chain-of-Thought","created":"2024-11-29","cited_by_count":51},{"id":"2408.16293","title":"Physics of Language Models: Part 2.2, How to Learn From Mistakes on Grade-School Math Problems","created":"2024-08-29","cited_by_count":50},{"id":"2408.10914","title":"To Code, or Not To Code? Exploring Impact of Code in Pre-training","created":"2024-08-20","cited_by_count":47},{"id":"2301.13442","title":"Scaling laws for single-agent reinforcement learning","created":"2023-01-31","cited_by_count":41},{"id":"2411.12580","title":"Procedural Knowledge in Pretraining Drives Reasoning in Large Language Models","created":"2024-11-19","cited_by_count":41},{"id":"2403.11793","title":"Reasoning Abilities of Large Language Models: In-Depth Analysis on the Abstraction and Reasoning Corpus","created":"2024-03-18","cited_by_count":32},{"id":"2401.11374","title":"Language Models as Hierarchy Encoders","created":"2024-01-21","cited_by_count":28},{"id":"2404.16367","title":"Learning Syntax Without Planting Trees: Understanding Hierarchical Generalization in Transformers","created":"2024-04-25","cited_by_count":24},{"id":"2410.23933","title":"Language Models can Self-Lengthen to Generate Long Texts","created":"2024-10-31","cited_by_count":24},{"id":"2407.16831","title":"Networks of Networks: Complexity Class Principles Applied to Compound AI Systems Design","created":"2024-07-23","cited_by_count":13},{"id":"2403.14734","title":"A Survey of Neural Code Intelligence: Paradigms, Advances and Beyond","created":"2024-03-21","cited_by_count":12},{"id":"2407.03181","title":"Fine-Tuning on Diverse Reasoning Chains Drives Within-Inference CoT Refinement in LLMs","created":"2024-07-03","cited_by_count":12},{"id":"2307.09423","title":"Scaling Laws for Imitation Learning in Single-Agent Games","created":"2023-07-18","cited_by_count":11},{"id":"2402.12399","title":"Turn Waste into Worth: Rectifying Top-$k$ Router of MoE","created":"2024-02-17","cited_by_count":11},{"id":"2402.11532","title":"Chain-of-Instructions: Compositional Instruction Tuning on Large Language Models","created":"2024-02-18","cited_by_count":9},{"id":"2406.06887","title":"$\\textbf{PLUM}$: Improving Code LMs with Execution-Guided On-Policy Preference Learning Driven By Synthetic Test Cases","created":"2024-06-11","cited_by_count":8},{"id":"2410.01735","title":"LASeR: Learning to Adaptively Select Reward Models with Multi-Armed Bandits","created":"2024-10-02","cited_by_count":7},{"id":"2305.19472","title":"PlaSma: Making Small Language Models Better Procedural Knowledge Models for (Counterfactual) Planning","created":"2023-05-31","cited_by_count":4},{"id":"2411.00660","title":"Physics in Next-token Prediction","created":"2024-11-01","cited_by_count":1}],"next_cursor":null}