{"list":"other","total":104,"rows":[{"id":"2005.14165","title":"Language Models are Few-Shot Learners","created":"2020-05-28","cited_by_count":32419},{"id":"2203.02155","title":"Training language models to follow instructions with human feedback","created":"2022-03-04","cited_by_count":15971},{"id":"2201.11903","title":"Chain-of-Thought Prompting Elicits Reasoning in Large Language Models","created":"2022-01-28","cited_by_count":12459},{"id":"2110.14168","title":"Training Verifiers to Solve Math Word Problems","created":"2021-10-27","cited_by_count":10109},{"id":"2107.03374","title":"Evaluating Large Language Models Trained on Code","created":"2021-07-07","cited_by_count":8320},{"id":"2305.18290","title":"Direct Preference Optimization: Your Language Model is Secretly a Reward Model","created":"2023-05-29","cited_by_count":8065},{"id":"2103.03874","title":"Measuring Mathematical Problem Solving With the MATH Dataset","created":"2021-03-05","cited_by_count":5371},{"id":"2108.07732","title":"Program Synthesis with Large Language Models","created":"2021-08-16","cited_by_count":3637},{"id":"2212.10560","title":"Self-Instruct: Aligning Language Models with Self-Generated Instructions","created":"2022-12-20","cited_by_count":2724},{"id":"2210.09261","title":"Challenging BIG-Bench Tasks and Whether Chain-of-Thought Can Solve Them","created":"2022-10-17","cited_by_count":1807},{"id":"2203.07814","title":"Competition-Level Code Generation with AlphaCode","created":"2022-02-08","cited_by_count":1462},{"id":"1812.02900","title":"Off-Policy Deep Reinforcement Learning without Exploration","created":"2018-12-07","cited_by_count":1241},{"id":"2401.14196","title":"DeepSeek-Coder: When the Large Language Model Meets Programming -- The Rise of Code Intelligence","created":"2024-01-25","cited_by_count":1181},{"id":"2304.12244","title":"WizardLM: Empowering large pre-trained language models to follow complex instructions","created":"2023-04-24","cited_by_count":1125},{"id":"2310.12036","title":"A General Theoretical Paradigm to Understand Learning from Human Preferences","created":"2023-10-18","cited_by_count":912},{"id":"2404.04475","title":"Length-Controlled AlpacaEval: A Simple Way to Debias Automatic Evaluators","created":"2024-04-06","cited_by_count":897},{"id":"1906.00949","title":"Stabilizing Off-Policy Q-Learning via Bootstrapping Error Reduction","created":"2019-06-03","cited_by_count":840},{"id":"1910.00177","title":"Advantage-Weighted Regression: Simple and Scalable Off-Policy Reinforcement Learning","created":"2019-10-01","cited_by_count":782},{"id":"2202.10054","title":"Fine-Tuning can Distort Pretrained Features and Underperform Out-of-Distribution","created":"2022-02-21","cited_by_count":739},{"id":"2309.12284","title":"MetaMath: Bootstrap Your Own Mathematical Questions for Large Language Models","created":"2023-09-21","cited_by_count":735},{"id":"2304.07327","title":"OpenAssistant Conversations -- Democratizing Large Language Model Alignment","created":"2023-04-14","cited_by_count":721},{"id":"2112.08633","title":"Learning To Retrieve Prompts for In-Context Learning","created":"2021-12-16","cited_by_count":648},{"id":"2308.08747","title":"An Empirical Study of Catastrophic Forgetting in Large Language Models During Continual Fine-tuning","created":"2023-08-17","cited_by_count":639},{"id":"2405.01470","title":"WildChat: 1M ChatGPT Interaction Logs in the Wild","created":"2024-05-02","cited_by_count":629},{"id":"2401.09670","title":"DistServe: Disaggregating Prefill and Decoding for Goodput-optimized Large Language Model Serving","created":"2024-01-18","cited_by_count":617},{"id":"2107.07075","title":"Deep Learning on a Data Diet: Finding Important Examples Early in Training","created":"2021-07-15","cited_by_count":533},{"id":"2402.04333","title":"LESS: Selecting Influential Data for Targeted Instruction Tuning","created":"2024-02-06","cited_by_count":532},{"id":"2006.05929","title":"Dataset Condensation with Gradient Matching","created":"2020-06-10","cited_by_count":516},{"id":"2308.08998","title":"Reinforced Self-Training (ReST) for Language Modeling","created":"2023-08-17","cited_by_count":500},{"id":"2309.05653","title":"MAmmoTH: Building Math Generalist Models through Hybrid Instruction Tuning","created":"2023-09-11","cited_by_count":487},{"id":"2309.11998","title":"LMSYS-Chat-1M: A Large-Scale Real-World LLM Conversation Dataset","created":"2023-09-21","cited_by_count":461},{"id":"1906.05271","title":"Does Learning Require Memorization? A Short Tale about a Long Tail","created":"2019-06-12","cited_by_count":460},{"id":"2406.06592","title":"Improve Mathematical Reasoning in Language Models by Automated Process Supervision","created":"2024-06-05","cited_by_count":441},{"id":"2310.01377","title":"UltraFeedback: Boosting Language Models with Scaled AI Feedback","created":"2023-10-02","cited_by_count":406},{"id":"2312.15685","title":"What Makes Good Data for Alignment? A Comprehensive Study of Automatic Data Selection in Instruction Tuning","created":"2023-12-25","cited_by_count":364},{"id":"2305.17493","title":"The Curse of Recursion: Training on Generated Data Makes Models Forget","created":"2023-05-27","cited_by_count":356},{"id":"2312.11456","title":"Iterative Preference Learning from Human Feedback: Bridging Theory and Practice for RLHF under KL-Constraint","created":"2023-12-18","cited_by_count":350},{"id":"2406.08464","title":"Magpie: Alignment Data Synthesis from Scratch by Prompting Aligned LLMs with Nothing","created":"2024-06-12","cited_by_count":346},{"id":"1511.03722","title":"Doubly Robust Off-policy Value Evaluation for Reinforcement Learning","created":"2015-11-11","cited_by_count":339},{"id":"2305.03047","title":"Principle-Driven Self-Alignment of Language Models from Scratch with Minimal Human Supervision","created":"2023-05-04","cited_by_count":318},{"id":"2308.12032","title":"From Quantity to Quality: Boosting LLM Performance with Self-Guided Data Selection for Instruction Tuning","created":"2023-08-23","cited_by_count":307},{"id":"2006.15134","title":"Critic Regularized Regression","created":"2020-06-26","cited_by_count":275},{"id":"2404.10719","title":"Is DPO Superior to PPO for LLM Alignment? A Comprehensive Study","created":"2024-04-16","cited_by_count":262},{"id":"2402.04792","title":"Direct Language Model Alignment from Online AI Feedback","created":"2024-02-07","cited_by_count":260},{"id":"2307.01850","title":"Self-Consuming Generative Models Go MAD","created":"2023-07-04","cited_by_count":250},{"id":"2206.07137","title":"Prioritized Training on Points that are Learnable, Worth Learning, and Not Yet Learnt","created":"2022-06-14","cited_by_count":236},{"id":"2206.02336","title":"Making Large Language Models Better Reasoners with Step-Aware Verifier","created":"2022-06-06","cited_by_count":233},{"id":"2404.14294","title":"A Survey on Efficient Inference for Large Language Models","created":"2024-04-22","cited_by_count":205},{"id":"2309.05196","title":"Does Writing with Language Models Reduce Content Diversity?","created":"2023-09-11","cited_by_count":192},{"id":"2404.14367","title":"Preference Fine-Tuning of LLMs Should Leverage Suboptimal, On-Policy Data","created":"2024-04-22","cited_by_count":185},{"id":"2002.05715","title":"Self-Distillation Amplifies Regularization in Hilbert Space","created":"2020-02-13","cited_by_count":173},{"id":"2402.19255","title":"GSM-Plus: A Comprehensive Benchmark for Evaluating the Robustness of LLMs as Mathematical Problem Solvers","created":"2024-02-29","cited_by_count":158},{"id":"2008.03156","title":"Better Fine-Tuning by Reducing Representational Collapse","created":"2020-08-06","cited_by_count":157},{"id":"2404.01413","title":"Is Model Collapse Inevitable? Breaking the Curse of Recursion by Accumulating Real and Synthetic Data","created":"2024-04-01","cited_by_count":151},{"id":"2309.10105","title":"Understanding Catastrophic Forgetting in Language Models via Implicit Inference","created":"2023-09-18","cited_by_count":144},{"id":"2402.00530","title":"Superfiltering: Weak-to-Strong Data Filtering for Fast Instruction-Tuning","created":"2024-02-01","cited_by_count":138},{"id":"2307.15936","title":"A Theory for Emergence of Complex Skills in Language Models","created":"2023-07-29","cited_by_count":113},{"id":"2405.08448","title":"Understanding the performance gap between online and offline alignment algorithms","created":"2024-05-14","cited_by_count":110},{"id":"2405.16436","title":"Provably Mitigating Overoptimization in RLHF: Your SFT Loss is Implicitly an Adversarial Regularizer","created":"2024-05-26","cited_by_count":109},{"id":"2311.15653","title":"MoDS: Model-oriented Data Selection for Instruction Tuning","created":"2023-11-27","cited_by_count":107},{"id":"2404.07503","title":"Best Practices and Lessons Learned on Synthetic Data","created":"2024-04-11","cited_by_count":106},{"id":"2406.14532","title":"RL on Incorrect Synthetic Data Scales the Efficiency of LLM Math Reasoning by Eight-Fold","created":"2024-06-20","cited_by_count":99},{"id":"2402.13669","title":"Self-Distillation Bridges Distribution Gap in Language Model Fine-Tuning","created":"2024-02-21","cited_by_count":96},{"id":"2402.10210","title":"Self-Play Fine-Tuning of Diffusion Models for Text-to-Image Generation","created":"2024-02-15","cited_by_count":85},{"id":"2405.20541","title":"Perplexed by Perplexity: Perplexity-Based Data Pruning With Small Reference Models","created":"2024-05-30","cited_by_count":84},{"id":"2311.16822","title":"Large Language Models Suffer From Their Own Output: An Analysis of the Self-Consuming Training Loop","created":"2023-11-28","cited_by_count":79},{"id":"2402.05119","title":"A Closer Look at the Limitations of Instruction Tuning","created":"2024-02-03","cited_by_count":77},{"id":"2010.03648","title":"A Mathematical Exploration of Why Language Models Help Solve Downstream Tasks","created":"2020-10-07","cited_by_count":72},{"id":"2405.19332","title":"Self-Exploring Language Models: Active Preference Elicitation for Online Alignment","created":"2024-05-29","cited_by_count":63},{"id":"2211.08095","title":"Will Large-scale Generative Models Corrupt Future Datasets?","created":"2022-11-15","cited_by_count":59},{"id":"2402.10110","title":"Selective Reflection-Tuning: Student-Selected Data Recycling for LLM Instruction-Tuning","created":"2024-02-15","cited_by_count":57},{"id":"2311.00288","title":"Active Instruction Tuning: Improving Cross-Task Generalization by Training on Prompt Sensitive Tasks","created":"2023-11-01","cited_by_count":55},{"id":"2306.06130","title":"Towards Understanding the Interplay of Generative Artificial Intelligence and the Internet","created":"2023-06-08","cited_by_count":54},{"id":"2406.11827","title":"WPO: Enhancing RLHF with Weighted Preference Optimization","created":"2024-06-17","cited_by_count":54},{"id":"2311.08648","title":"Explore Spurious Correlations at the Concept Level in Language Models for Text Classification","created":"2023-11-15","cited_by_count":48},{"id":"2404.10859","title":"Forcing Diffuse Distributions out of Language Models","created":"2024-04-16","cited_by_count":48},{"id":"2402.10738","title":"Let's Learn Step by Step: Enhancing In-Context Learning Ability with Curriculum Learning","created":"2024-02-16","cited_by_count":47},{"id":"2403.07384","title":"SmallToLarge (S2L): Scalable Data Selection for Fine-tuning Large Language Models by Summarizing Training Trajectories of Small Models","created":"2024-03-12","cited_by_count":44},{"id":"2302.11312","title":"Behavior Proximal Policy Optimization","created":"2023-02-22","cited_by_count":43},{"id":"2303.01255","title":"Combining Generative Artificial Intelligence (AI) and the Internet: Heading towards Evolution or Degradation?","created":"2023-02-17","cited_by_count":41},{"id":"2410.06961","title":"Self-Boosting Large Language Models with Synthetic Preference Data","created":"2024-10-09","cited_by_count":40},{"id":"2406.19976","title":"ScaleBiO: Scalable Bilevel Optimization for LLM Data Reweighting","created":"2024-06-28","cited_by_count":37},{"id":"2406.10323","title":"GenQA: Generating Millions of Instructions from a Handful of Prompts","created":"2024-06-14","cited_by_count":35},{"id":"2312.11508","title":"Rethinking the Instruction Quality: LIFT is What You Need","created":"2023-12-12","cited_by_count":34},{"id":"2402.10430","title":"Smaller Language Models are capable of selecting Instruction-Tuning Training Data for Larger Language Models","created":"2024-02-16","cited_by_count":32},{"id":"2405.02774","title":"Get more for less: Principled Data Selection for Warming Up Fine-Tuning in LLMs","created":"2024-05-05","cited_by_count":32},{"id":"2407.15235","title":"TAGCOS: Task-agnostic Gradient Clustered Coreset Selection for Instruction Tuning Data","created":"2024-07-21","cited_by_count":30},{"id":"2305.19249","title":"Preserving Pre-trained Features Helps Calibrate Fine-tuned Language Models","created":"2023-05-30","cited_by_count":29},{"id":"2402.02318","title":"Diversity Measurement and Subset Selection for Instruction Tuning Datasets","created":"2024-02-04","cited_by_count":29},{"id":"2406.00770","title":"Automatic Instruction Evolving for Large Language Models","created":"2024-06-02","cited_by_count":26},{"id":"2401.06692","title":"An Experimental Design Framework for Label-Efficient Supervised Finetuning of Large Language Models","created":"2024-01-12","cited_by_count":23},{"id":"2501.12147","title":"Improving Influence-based Instruction Tuning Data Selection for Balanced Learning of Diverse Capabilities","created":"2025-01-21","cited_by_count":23},{"id":"2203.12788","title":"Evaluating Distributional Distortion in Neural Language Modeling","created":"2022-03-24","cited_by_count":19},{"id":"2401.16553","title":"SelectLLM: Can LLMs Select Important Instructions to Annotate?","created":"2024-01-29","cited_by_count":16},{"id":"2411.07133","title":"Stronger Models are NOT Stronger Teachers for Instruction Tuning","created":"2024-11-11","cited_by_count":16},{"id":"2310.09518","title":"Instruction Tuning with Human Curriculum","created":"2023-10-14","cited_by_count":15},{"id":"2409.19759","title":"Balancing Cost and Effectiveness of Synthetic Data Generation Strategies for LLMs","created":"2024-09-29","cited_by_count":15},{"id":"2310.02527","title":"CITING: Large Language Models Create Curriculum for Instruction Tuning","created":"2023-10-04","cited_by_count":14},{"id":"2410.18585","title":"Aligning CodeLLMs with Direct Preference Optimization","created":"2024-10-24","cited_by_count":9},{"id":"2406.06887","title":"$\\textbf{PLUM}$: Improving Code LMs with Execution-Guided On-Policy Preference Learning Driven By Synthetic Test Cases","created":"2024-06-11","cited_by_count":8}],"next_cursor":"100"}