{"list":"other","total":106,"rows":[{"id":"1706.03762","title":"Attention Is All You Need","created":"2017-06-12","cited_by_count":60361},{"id":"1810.04805","title":"BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding","created":"2018-10-11","cited_by_count":40399},{"id":"2005.14165","title":"Language Models are Few-Shot Learners","created":"2020-05-28","cited_by_count":32419},{"id":"2203.02155","title":"Training language models to follow instructions with human feedback","created":"2022-03-04","cited_by_count":15971},{"id":"1707.06347","title":"Proximal Policy Optimization Algorithms","created":"2017-07-20","cited_by_count":15215},{"id":"1910.10683","title":"Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer","created":"2019-10-23","cited_by_count":14599},{"id":"2201.11903","title":"Chain-of-Thought Prompting Elicits Reasoning in Large Language Models","created":"2022-01-28","cited_by_count":12459},{"id":"1602.05629","title":"Communication-Efficient Learning of Deep Networks from Decentralized Data","created":"2016-02-17","cited_by_count":7669},{"id":"1312.6199","title":"Intriguing properties of neural networks","created":"2013-12-21","cited_by_count":5155},{"id":"1706.04599","title":"On Calibration of Modern Neural Networks","created":"2017-06-14","cited_by_count":4960},{"id":"2108.07258","title":"On the Opportunities and Risks of Foundation Models","created":"2021-08-16","cited_by_count":4033},{"id":"1612.01474","title":"Simple and Scalable Predictive Uncertainty Estimation using Deep Ensembles","created":"2016-12-05","cited_by_count":3926},{"id":"2109.01652","title":"Finetuned Language Models Are Zero-Shot Learners","created":"2021-09-03","cited_by_count":3780},{"id":"2212.08073","title":"Constitutional AI: Harmlessness from AI Feedback","created":"2022-12-15","cited_by_count":3050},{"id":"1903.12261","title":"Benchmarking Neural Network Robustness to Common Corruptions and Perturbations","created":"2019-03-28","cited_by_count":2877},{"id":"2303.12712","title":"Sparks of Artificial General Intelligence: Early experiments with GPT-4","created":"2023-03-22","cited_by_count":2592},{"id":"2009.01325","title":"Learning to summarize from human feedback","created":"2020-09-02","cited_by_count":2588},{"id":"1907.02893","title":"Invariant Risk Minimization","created":"2019-07-05","cited_by_count":1854},{"id":"1611.03530","title":"Understanding deep learning requires rethinking generalization","created":"2016-11-10","cited_by_count":1674},{"id":"1606.06565","title":"Concrete Problems in AI Safety","created":"2016-06-21","cited_by_count":1642},{"id":"2203.05482","title":"Model soups: averaging weights of multiple fine-tuned models improves accuracy without increasing inference time","created":"2022-03-10","cited_by_count":1396},{"id":"2012.07421","title":"WILDS: A Benchmark of in-the-Wild Distribution Shifts","created":"2020-12-14","cited_by_count":1375},{"id":"1902.02918","title":"Certified Adversarial Robustness via Randomized Smoothing","created":"2019-02-08","cited_by_count":1340},{"id":"1906.02530","title":"Can You Trust Your Model's Uncertainty? Evaluating Predictive Uncertainty Under Dataset Shift","created":"2019-06-06","cited_by_count":1287},{"id":"1803.05407","title":"Averaging Weights Leads to Wider Optima and Better Generalization","created":"2018-03-14","cited_by_count":1209},{"id":"2305.10403","title":"PaLM 2 Technical Report","created":"2023-05-17","cited_by_count":1162},{"id":"2212.04089","title":"Editing Models with Task Arithmetic","created":"2022-12-08","cited_by_count":1120},{"id":"1804.06872","title":"Co-teaching: Robust Training of Deep Neural Networks with Extremely Noisy Labels","created":"2018-04-18","cited_by_count":1059},{"id":"2112.00861","title":"A General Language Assistant as a Laboratory for Alignment","created":"2021-12-01","cited_by_count":1055},{"id":"2007.01434","title":"In Search of Lost Domain Generalization","created":"2020-07-02","cited_by_count":1054},{"id":"2310.13548","title":"Towards Understanding Sycophancy in Language Models","created":"2023-10-20","cited_by_count":1040},{"id":"2310.12036","title":"A General Theoretical Paradigm to Understand Learning from Human Preferences","created":"2023-10-18","cited_by_count":912},{"id":"1804.04235","title":"Adafactor: Adaptive Learning Rates with Sublinear Memory Cost","created":"2018-04-11","cited_by_count":905},{"id":"2204.07705","title":"Super-NaturalInstructions: Generalization via Declarative Instructions on 1600+ NLP Tasks","created":"2022-04-16","cited_by_count":868},{"id":"2212.09251","title":"Discovering Language Model Behaviors with Model-Written Evaluations","created":"2022-12-19","cited_by_count":836},{"id":"2310.11324","title":"Quantifying Language Models' Sensitivity to Spurious Features in Prompt Design or: How I learned to start worrying about prompt formatting","created":"2023-10-17","cited_by_count":817},{"id":"2109.01903","title":"Robust fine-tuning of zero-shot models","created":"2021-09-04","cited_by_count":797},{"id":"2303.17548","title":"Whose Opinions Do Language Models Reflect?","created":"2023-03-30","cited_by_count":773},{"id":"2305.14387","title":"AlpacaFarm: A Simulation Framework for Methods that Learn from Human Feedback","created":"2023-05-22","cited_by_count":748},{"id":"2202.10054","title":"Fine-Tuning can Distort Pretrained Features and Underperform Out-of-Distribution","created":"2022-02-21","cited_by_count":739},{"id":"2209.07858","title":"Red Teaming Language Models to Reduce Harms: Methods, Scaling Behaviors, and Lessons Learned","created":"2022-08-23","cited_by_count":729},{"id":"2309.14525","title":"Aligning Large Multimodal Models with Factually Augmented RLHF","created":"2023-09-25","cited_by_count":712},{"id":"1712.05055","title":"MentorNet: Learning Data-Driven Curriculum for Very Deep Neural Networks on Corrupted Labels","created":"2017-12-14","cited_by_count":653},{"id":"1912.05671","title":"Linear Mode Connectivity and the Lottery Ticket Hypothesis","created":"2019-12-11","cited_by_count":637},{"id":"1301.2115","title":"Domain Generalization via Invariant Feature Representation","created":"2013-01-10","cited_by_count":623},{"id":"2007.08199","title":"Learning from Noisy Labels with Deep Neural Networks: A Survey","created":"2020-07-16","cited_by_count":582},{"id":"2011.03395","title":"Underspecification Presents Challenges for Credibility in Modern Machine Learning","created":"2020-11-06","cited_by_count":496},{"id":"2209.04836","title":"Git Re-Basin: Merging Models modulo Permutation Symmetries","created":"2022-09-11","cited_by_count":471},{"id":"1712.09482","title":"Robust Loss Functions under Label Noise for Deep Neural Networks","created":"2017-12-27","cited_by_count":443},{"id":"2102.08604","title":"SWAD: Domain Generalization by Seeking Flat Minima","created":"2021-02-17","cited_by_count":434},{"id":"2204.02937","title":"Last Layer Re-Training is Sufficient for Robustness to Spurious Correlations","created":"2022-04-06","cited_by_count":381},{"id":"1807.00431","title":"Confounding variables can degrade generalization performance of radiological deep learning models","created":"2018-07-02","cited_by_count":379},{"id":"2008.11687","title":"What is being transferred in transfer learning?","created":"2020-08-26","cited_by_count":368},{"id":"2201.03544","title":"The Effects of Reward Misspecification: Mapping and Mitigating Misaligned Models","created":"2022-01-10","cited_by_count":328},{"id":"2401.00595","title":"State of What Art? A Call for Multi-Prompt LLM Evaluation","created":"2023-12-31","cited_by_count":310},{"id":"2109.10862","title":"Recursively Summarizing Books with Human Feedback","created":"2021-09-22","cited_by_count":290},{"id":"1901.11275","title":"A Theory of Regularized Markov Decision Processes","created":"2019-01-31","cited_by_count":286},{"id":"2011.09468","title":"Gradient Starvation: A Learning Proclivity in Neural Networks","created":"2020-11-18","cited_by_count":267},{"id":"2209.00626","title":"The Alignment Problem from a Deep Learning Perspective","created":"2022-08-30","cited_by_count":258},{"id":"2211.03540","title":"Measuring Progress on Scalable Oversight for Large Language Models","created":"2022-11-04","cited_by_count":225},{"id":"1706.05125","title":"Deal or No Deal? End-to-End Learning for Negotiation Dialogues","created":"2017-06-16","cited_by_count":209},{"id":"2208.03306","title":"Branch-Train-Merge: Embarrassingly Parallel Training of Expert Language Models","created":"2022-08-05","cited_by_count":191},{"id":"2208.05592","title":"Patching open-vocabulary models by interpolating weights","created":"2022-08-10","cited_by_count":190},{"id":"2301.01768","title":"The political ideology of conversational AI: Converging evidence on ChatGPT's pro-environmental, left-libertarian orientation","created":"2023-01-05","cited_by_count":189},{"id":"2109.02934","title":"Fishr: Invariant Gradient Variances for Out-of-Distribution Generalization","created":"2021-09-07","cited_by_count":186},{"id":"1705.08475","title":"Formal Guarantees on the Robustness of a Classifier against Adversarial Manipulation","created":"2017-05-23","cited_by_count":185},{"id":"2205.09739","title":"Diverse Weight Averaging for Out-of-Distribution Generalization","created":"2022-05-19","cited_by_count":148},{"id":"2110.10832","title":"Ensemble of Averages: Improving Model Selection and Boosting Performance in Domain Generalization","created":"2021-10-21","cited_by_count":144},{"id":"2102.10395","title":"On Calibration and Out-of-domain Generalization","created":"2021-02-20","cited_by_count":134},{"id":"1902.03680","title":"Learning From Noisy Labels By Regularized Estimation Of Annotator Confusion","created":"2019-02-10","cited_by_count":127},{"id":"2401.01879","title":"Theoretical guarantees on the best-of-n alignment policy","created":"2024-01-03","cited_by_count":124},{"id":"1605.08254","title":"Robust Large Margin Deep Neural Networks","created":"2016-05-26","cited_by_count":118},{"id":"1707.05173","title":"Trial without Error: Towards Safe Reinforcement Learning via Human Intervention","created":"2017-07-17","cited_by_count":103},{"id":"1611.02796","title":"Sequence Tutor: Conservative Fine-Tuning of Sequence Generation Models with KL-control","created":"2016-11-09","cited_by_count":101},{"id":"2310.05914","title":"NEFTune: Noisy Embeddings Improve Instruction Finetuning","created":"2023-10-09","cited_by_count":100},{"id":"2212.10445","title":"Model Ratatouille: Recycling Diverse Models for Out-of-Distribution Generalization","created":"2022-12-20","cited_by_count":97},{"id":"2102.03896","title":"Consequences of Misaligned AI","created":"2021-02-07","cited_by_count":80},{"id":"2106.00445","title":"Sample Selection with Uncertainty of Losses for Learning with Noisy Labels","created":"2021-06-01","cited_by_count":79},{"id":"2306.00186","title":"Factually Consistent Summarization via Reinforcement Learning with Textual Entailment Feedback","created":"2023-05-31","cited_by_count":72},{"id":"2005.07064","title":"Multi-agent Communication meets Natural Language: Synergies between Functional and Structural Language Learning","created":"2020-05-14","cited_by_count":66},{"id":"2206.05862","title":"X-Risk Analysis for AI Research","created":"2022-06-13","cited_by_count":60},{"id":"2110.12899","title":"No One Representation to Rule Them All: Overlapping Features of Training Methods","created":"2021-10-20","cited_by_count":58},{"id":"2302.04863","title":"Knowledge is a Region in Weight Space for Fine-tuned Language Models","created":"2023-02-09","cited_by_count":58},{"id":"2003.12694","title":"Countering Language Drift with Seeded Iterated Learning","created":"2020-03-28","cited_by_count":57},{"id":"2205.12411","title":"Linear Connectivity Reveals Generalization Strategies","created":"2022-05-24","cited_by_count":56},{"id":"2212.01378","title":"ColD Fusion: Collaborative Descent for Distributed Multitask Finetuning","created":"2022-12-02","cited_by_count":52},{"id":"1906.09624","title":"On the Feasibility of Learning, Rather than Assuming, Human Biases for Reward Inference","created":"2019-06-23","cited_by_count":49},{"id":"2310.13798","title":"Specific versus General Principles for Constitutional AI","created":"2023-10-20","cited_by_count":47},{"id":"2209.00613","title":"ID and OOD Performance Are Sometimes Inversely Correlated on Real-world Datasets","created":"2022-09-01","cited_by_count":44},{"id":"2012.07969","title":"A case for new neural network smoothness constraints","created":"2020-12-14","cited_by_count":43},{"id":"2312.07551","title":"Language Model Alignment with Elastic Reset","created":"2023-12-06","cited_by_count":34},{"id":"2210.09759","title":"Pareto Manifold Learning: Tackling multiple tasks via ensembles of single-task models","created":"2022-10-18","cited_by_count":29},{"id":"2303.17574","title":"Elastic Weight Removal for Faithful and Abstractive Dialogue Generation","created":"2023-03-30","cited_by_count":29},{"id":"2310.20703","title":"Vanishing Gradients in Reinforcement Finetuning of Language Models","created":"2023-10-31","cited_by_count":27},{"id":"2309.17230","title":"Spurious Feature Diversification Improves Out-of-distribution Generalization","created":"2023-09-29","cited_by_count":26},{"id":"2303.16200","title":"Natural Selection Favors AIs over Humans","created":"2023-03-28","cited_by_count":24},{"id":"2302.10164","title":"Seasoning Model Soups for Robustness to Adversarial and Natural Distribution Shifts","created":"2023-02-20","cited_by_count":23},{"id":"2211.03186","title":"Momentum-based Weight Interpolation of Strong Zero-Shot Models for Continual Learning","created":"2022-11-06","cited_by_count":19},{"id":"2006.16785","title":"Lipschitzness Is All You Need To Tame Off-policy Generative Adversarial Imitation Learning","created":"2020-06-28","cited_by_count":15},{"id":"2303.07551","title":"Merging Decision Transformers: Weight Averaging for Forming Multi-Task Policies","created":"2023-03-14","cited_by_count":15}],"next_cursor":"100"}