{"list":"other","total":137,"rows":[{"id":"1706.03762","title":"Attention Is All You Need","created":"2017-06-12","cited_by_count":60361},{"id":"1810.04805","title":"BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding","created":"2018-10-11","cited_by_count":40399},{"id":"2005.14165","title":"Language Models are Few-Shot Learners","created":"2020-05-28","cited_by_count":32419},{"id":"2203.02155","title":"Training language models to follow instructions with human feedback","created":"2022-03-04","cited_by_count":15971},{"id":"1707.06347","title":"Proximal Policy Optimization Algorithms","created":"2017-07-20","cited_by_count":15215},{"id":"1910.10683","title":"Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer","created":"2019-10-23","cited_by_count":14599},{"id":"2302.13971","title":"LLaMA: Open and Efficient Foundation Language Models","created":"2023-02-27","cited_by_count":14132},{"id":"1907.11692","title":"RoBERTa: A Robustly Optimized BERT Pretraining Approach","created":"2019-07-26","cited_by_count":13372},{"id":"1503.02531","title":"Distilling the Knowledge in a Neural Network","created":"2015-03-09","cited_by_count":10324},{"id":"2110.14168","title":"Training Verifiers to Solve Math Word Problems","created":"2021-10-27","cited_by_count":10109},{"id":"2402.03300","title":"DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Models","created":"2024-02-05","cited_by_count":9379},{"id":"2001.08361","title":"Scaling Laws for Neural Language Models","created":"2020-01-23","cited_by_count":6586},{"id":"2204.02311","title":"PaLM: Scaling Language Modeling with Pathways","created":"2022-04-05","cited_by_count":5326},{"id":"2303.11366","title":"Reflexion: Language Agents with Verbal Reinforcement Learning","created":"2023-03-20","cited_by_count":4276},{"id":"2305.20050","title":"Let's Verify Step by Step","created":"2023-05-31","cited_by_count":3789},{"id":"2109.01652","title":"Finetuned Language Models Are Zero-Shot Learners","created":"2021-09-03","cited_by_count":3780},{"id":"2205.01068","title":"OPT: Open Pre-trained Transformer Language Models","created":"2022-05-02","cited_by_count":3512},{"id":"2303.17651","title":"Self-Refine: Iterative Refinement with Self-Feedback","created":"2023-03-30","cited_by_count":3442},{"id":"2212.08073","title":"Constitutional AI: Harmlessness from AI Feedback","created":"2022-12-15","cited_by_count":3050},{"id":"2203.15556","title":"Training Compute-Optimal Large Language Models","created":"2022-03-29","cited_by_count":3019},{"id":"2109.07958","title":"TruthfulQA: Measuring How Models Mimic Human Falsehoods","created":"2021-09-08","cited_by_count":2975},{"id":"2009.01325","title":"Learning to summarize from human feedback","created":"2020-09-02","cited_by_count":2588},{"id":"1602.01783","title":"Asynchronous Methods for Deep Reinforcement Learning","created":"2016-02-04","cited_by_count":2258},{"id":"2212.13138","title":"Large Language Models Encode Clinical Knowledge","created":"2022-12-26","cited_by_count":1830},{"id":"2307.02483","title":"Jailbroken: How Does LLM Safety Training Fail?","created":"2023-07-05","cited_by_count":1651},{"id":"2004.04696","title":"BLEURT: Learning Robust Metrics for Text Generation","created":"2020-04-09","cited_by_count":1203},{"id":"2112.11446","title":"Scaling Language Models: Methods, Analysis & Insights from Training Gopher","created":"2021-12-08","cited_by_count":1202},{"id":"1705.05363","title":"Curiosity-driven Exploration by Self-supervised Prediction","created":"2017-05-15","cited_by_count":1194},{"id":"1707.01495","title":"Hindsight Experience Replay","created":"2017-07-05","cited_by_count":1136},{"id":"2305.11206","title":"LIMA: Less Is More for Alignment","created":"2023-05-18","cited_by_count":1100},{"id":"2112.00861","title":"A General Language Assistant as a Laboratory for Alignment","created":"2021-12-01","cited_by_count":1055},{"id":"2202.03286","title":"Red Teaming Language Models with Language Models","created":"2022-02-07","cited_by_count":1026},{"id":"2305.13301","title":"Training Diffusion Models with Reinforcement Learning","created":"2023-05-22","cited_by_count":982},{"id":"2303.17564","title":"BloombergGPT: A Large Language Model for Finance","created":"2023-03-30","cited_by_count":939},{"id":"2310.12036","title":"A General Theoretical Paradigm to Understand Learning from Human Preferences","created":"2023-10-18","cited_by_count":912},{"id":"2211.14275","title":"Solving math word problems with process- and outcome-based feedback","created":"2022-11-25","cited_by_count":901},{"id":"2005.00661","title":"On Faithfulness and Factuality in Abstractive Summarization","created":"2020-05-02","cited_by_count":900},{"id":"2112.06905","title":"GLaM: Efficient Scaling of Language Models with Mixture-of-Experts","created":"2021-12-13","cited_by_count":897},{"id":"2303.17548","title":"Whose Opinions Do Language Models Reflect?","created":"2023-03-30","cited_by_count":773},{"id":"2209.07858","title":"Red Teaming Language Models to Reduce Harms: Methods, Scaling Behaviors, and Lessons Learned","created":"2022-08-23","cited_by_count":729},{"id":"2107.06499","title":"Deduplicating Training Data Makes Language Models Better","created":"2021-07-14","cited_by_count":714},{"id":"1912.02292","title":"Deep Double Descent: Where Bigger Models and More Data Hurt","created":"2019-12-04","cited_by_count":672},{"id":"2310.12773","title":"Safe RLHF: Safe Reinforcement Learning from Human Feedback","created":"2023-10-19","cited_by_count":656},{"id":"1606.01868","title":"Unifying Count-Based Exploration and Intrinsic Motivation","created":"2016-06-06","cited_by_count":639},{"id":"1511.06732","title":"Sequence Level Training with Recurrent Neural Networks","created":"2015-11-20","cited_by_count":576},{"id":"2209.14375","title":"Improving alignment of dialogue agents via targeted human judgements","created":"2022-09-28","cited_by_count":531},{"id":"1708.05866","title":"A Brief Survey of Deep Reinforcement Learning","created":"2017-08-19","cited_by_count":483},{"id":"2306.16388","title":"Towards Measuring the Representation of Subjective Global Opinions in Language Models","created":"2023-06-28","cited_by_count":437},{"id":"2203.09509","title":"ToxiGen: A Large-Scale Machine-Generated Dataset for Adversarial and Implicit Hate Speech Detection","created":"2022-03-17","cited_by_count":422},{"id":"2310.06694","title":"Sheared LLaMA: Accelerating Language Model Pre-training via Structured Pruning","created":"2023-10-10","cited_by_count":415},{"id":"2305.10429","title":"DoReMi: Optimizing Data Mixtures Speeds Up Language Model Pretraining","created":"2023-05-17","cited_by_count":399},{"id":"2304.05335","title":"Toxicity in ChatGPT: Analyzing Persona-assigned Language Models","created":"2023-04-11","cited_by_count":360},{"id":"1603.08023","title":"How NOT To Evaluate Your Dialogue System: An Empirical Study of Unsupervised Evaluation Metrics for Dialogue Response Generation","created":"2016-03-25","cited_by_count":356},{"id":"2305.17493","title":"The Curse of Recursion: Training on Generated Data Makes Models Forget","created":"2023-05-27","cited_by_count":356},{"id":"2201.03544","title":"The Effects of Reward Misspecification: Mapping and Mitigating Misaligned Models","created":"2022-01-10","cited_by_count":328},{"id":"2309.06657","title":"Statistical Rejection Sampling Improves Preference Optimization","created":"2023-09-13","cited_by_count":323},{"id":"2305.03047","title":"Principle-Driven Self-Alignment of Language Models from Scratch with Minimal Human Supervision","created":"2023-05-04","cited_by_count":318},{"id":"1806.06877","title":"A Survey of Inverse Reinforcement Learning: Challenges, Methods and Progress","created":"2018-06-18","cited_by_count":298},{"id":"2203.11147","title":"Teaching language models to support answers with verified quotes","created":"2022-03-21","cited_by_count":292},{"id":"2109.10862","title":"Recursively Summarizing Books with Human Feedback","created":"2021-09-22","cited_by_count":290},{"id":"2306.17492","title":"Preference Ranking Optimization for Human Alignment","created":"2023-06-30","cited_by_count":285},{"id":"1907.00456","title":"Way Off-Policy Batch Deep Reinforcement Learning of Implicit Human Preferences in Dialog","created":"2019-06-30","cited_by_count":284},{"id":"2305.15717","title":"The False Promise of Imitating Proprietary LLMs","created":"2023-05-25","cited_by_count":263},{"id":"2209.00626","title":"The Alignment Problem from a Deep Learning Perspective","created":"2022-08-30","cited_by_count":258},{"id":"2307.01850","title":"Self-Consuming Generative Models Go MAD","created":"2023-07-04","cited_by_count":250},{"id":"1711.02827","title":"Inverse Reward Design","created":"2017-11-08","cited_by_count":249},{"id":"2302.08582","title":"Pretraining Language Models with Human Preferences","created":"2023-02-16","cited_by_count":247},{"id":"2210.01241","title":"Is Reinforcement Learning (Not) for Natural Language Processing: Benchmarks, Baselines, and Building Blocks for Natural Language Policy Optimization","created":"2022-10-03","cited_by_count":246},{"id":"1402.0590","title":"A Survey of Multi-Objective Sequential Decision-Making","created":"2014-02-04","cited_by_count":242},{"id":"2311.10702","title":"Camels in a Changing Climate: Enhancing LM Adaptation with Tulu 2","created":"2023-11-17","cited_by_count":229},{"id":"1706.05125","title":"Deal or No Deal? End-to-End Learning for Negotiation Dialogues","created":"2017-06-16","cited_by_count":209},{"id":"2311.04892","title":"Bias Runs Deep: Implicit Reasoning Biases in Persona-Assigned LLMs","created":"2023-11-08","cited_by_count":199},{"id":"2210.06774","title":"Re3: Generating Longer Stories With Recursive Reprompting and Revision","created":"2022-10-13","cited_by_count":193},{"id":"2309.06256","title":"Mitigating the Alignment Tax of RLHF","created":"2023-09-12","cited_by_count":183},{"id":"2109.04838","title":"Block Pruning For Faster Transformers","created":"2021-09-10","cited_by_count":177},{"id":"2204.00408","title":"Structured Pruning Learns Compact and Accurate Models","created":"2022-04-01","cited_by_count":170},{"id":"2305.14552","title":"Sources of Hallucination by Large Language Models on Inference Tasks","created":"2023-05-23","cited_by_count":169},{"id":"2403.04642","title":"Teaching Large Language Models to Reason with Reinforcement Learning","created":"2024-03-07","cited_by_count":160},{"id":"1607.07086","title":"An Actor-Critic Algorithm for Sequence Prediction","created":"2016-07-24","cited_by_count":159},{"id":"2205.10487","title":"Scaling Laws and Interpretability of Learning from Repeated Data","created":"2022-05-21","cited_by_count":152},{"id":"2304.03738","title":"Should ChatGPT be Biased? Challenges and Risks of Bias in Large Language Models","created":"2023-04-07","cited_by_count":148},{"id":"2205.11275","title":"RL with KL penalties is better viewed as Bayesian inference","created":"2022-05-23","cited_by_count":135},{"id":"2303.16755","title":"Training Language Models with Language Feedback at Scale","created":"2023-03-28","cited_by_count":128},{"id":"2210.00045","title":"Calibrating Sequence likelihood Improves Conditional Language Generation","created":"2022-09-30","cited_by_count":121},{"id":"1512.02433","title":"Minimum Risk Training for Neural Machine Translation","created":"2015-12-08","cited_by_count":115},{"id":"2311.14648","title":"Calibrated Language Models Must Hallucinate","created":"2023-11-24","cited_by_count":115},{"id":"1901.05415","title":"Learning from Dialogue after Deployment: Feed Yourself, Chatbot!","created":"2019-01-16","cited_by_count":102},{"id":"2303.13379","title":"Practical and Ethical Challenges of Large Language Models in Education: A Systematic Scoping Review","created":"2023-03-17","cited_by_count":83},{"id":"1907.01752","title":"On the Weaknesses of Reinforcement Learning for Neural Machine Translation","created":"2019-07-03","cited_by_count":82},{"id":"2303.16749","title":"Improving Code Generation by Training with Natural Language Feedback","created":"2023-03-28","cited_by_count":76},{"id":"2305.13735","title":"Aligning Large Language Models through Synthetic Feedback","created":"2023-05-23","cited_by_count":75},{"id":"1707.07402","title":"Reinforcement Learning for Bandit Neural Machine Translation with Simulated Human Feedback","created":"2017-07-24","cited_by_count":72},{"id":"1804.05958","title":"Can Neural Machine Translation be Improved with User Feedback?","created":"2018-04-16","cited_by_count":72},{"id":"1711.00279","title":"Paraphrase Generation with Deep Reinforcement Learning","created":"2017-11-01","cited_by_count":58},{"id":"1711.04987","title":"Unified Pragmatic Models for Generating and Following Instructions","created":"2017-11-14","cited_by_count":55},{"id":"2305.00955","title":"Bridging the Gap: A Survey on Integrating (Human) Feedback for Natural Language Generation","created":"2023-05-01","cited_by_count":55},{"id":"2202.04628","title":"Reinforcement Learning with Sparse Rewards using Guidance from Offline Demonstration","created":"2022-02-09","cited_by_count":54},{"id":"1804.06512","title":"Dialogue Learning with Human Teaching and Feedback in End-to-End Trainable Task-Oriented Dialogue Systems","created":"2018-04-18","cited_by_count":53},{"id":"2204.14146","title":"Training Language Models with Language Feedback","created":"2022-04-29","cited_by_count":49},{"id":"2205.00978","title":"Quality-Aware Decoding for Neural Machine Translation","created":"2022-05-02","cited_by_count":49}],"next_cursor":"100"}