{"list":"other","total":70,"rows":[{"id":"2005.14165","title":"Language Models are Few-Shot Learners","created":"2020-05-28","cited_by_count":32419},{"id":"2203.02155","title":"Training language models to follow instructions with human feedback","created":"2022-03-04","cited_by_count":15971},{"id":"1907.11692","title":"RoBERTa: A Robustly Optimized BERT Pretraining Approach","created":"2019-07-26","cited_by_count":13372},{"id":"2001.08361","title":"Scaling Laws for Neural Language Models","created":"2020-01-23","cited_by_count":6586},{"id":"1703.03400","title":"Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networks","created":"2017-03-09","cited_by_count":4897},{"id":"2204.14198","title":"Flamingo: a Visual Language Model for Few-Shot Learning","created":"2022-04-29","cited_by_count":4386},{"id":"2109.01652","title":"Finetuned Language Models Are Zero-Shot Learners","created":"2021-09-03","cited_by_count":3780},{"id":"1606.04080","title":"Matching Networks for One Shot Learning","created":"2016-06-13","cited_by_count":2255},{"id":"2004.07780","title":"Shortcut Learning in Deep Neural Networks","created":"2020-04-16","cited_by_count":1969},{"id":"2106.01345","title":"Decision Transformer: Reinforcement Learning via Sequence Modeling","created":"2021-06-02","cited_by_count":1546},{"id":"2202.12837","title":"Rethinking the Role of Demonstrations: What Makes In-Context Learning Work?","created":"2022-02-25","cited_by_count":1434},{"id":"1802.07569","title":"Continual Lifelong Learning with Neural Networks: A Review","created":"2018-02-21","cited_by_count":1330},{"id":"2104.08786","title":"Fantastically Ordered Prompts and Where to Find Them: Overcoming Few-Shot Prompt Order Sensitivity","created":"2021-04-18","cited_by_count":1135},{"id":"2209.11895","title":"In-context Learning and Induction Heads","created":"2022-09-24","cited_by_count":964},{"id":"2111.02080","title":"An Explanation of In-context Learning as Implicit Bayesian Inference","created":"2021-11-03","cited_by_count":938},{"id":"2310.11324","title":"Quantifying Language Models' Sensitivity to Spurious Features in Prompt Design or: How I learned to start worrying about prompt formatting","created":"2023-10-17","cited_by_count":817},{"id":"2212.07677","title":"Transformers learn in-context by gradient descent","created":"2022-12-15","cited_by_count":732},{"id":"2211.15661","title":"What learning algorithm is in-context learning? Investigations with linear models","created":"2022-11-28","cited_by_count":684},{"id":"2201.02177","title":"Grokking: Generalization Beyond Overfitting on Small Algorithmic Datasets","created":"2022-01-06","cited_by_count":629},{"id":"2102.07350","title":"Prompt Programming for Large Language Models: Beyond the Few-Shot Paradigm","created":"2021-02-15","cited_by_count":606},{"id":"1611.02779","title":"RL$^2$: Fast Reinforcement Learning via Slow Reinforcement Learning","created":"2016-11-09","cited_by_count":503},{"id":"2310.07820","title":"Large Language Models Are Zero-Shot Time Series Forecasters","created":"2023-10-11","cited_by_count":500},{"id":"2303.03846","title":"Larger language models do in-context learning differently","created":"2023-03-07","cited_by_count":394},{"id":"1611.05763","title":"Learning to reinforcement learn","created":"2016-11-17","cited_by_count":377},{"id":"2306.09927","title":"Trained Transformers Learn Linear Models In-Context","created":"2023-06-16","cited_by_count":337},{"id":"2109.01247","title":"Do Prompt-Based Models Really Understand the Meaning of their Prompts?","created":"2021-09-02","cited_by_count":326},{"id":"2205.05055","title":"Data Distributional Properties Drive Emergent In-Context Learning in Transformers","created":"2022-04-22","cited_by_count":309},{"id":"2305.16367","title":"Role-Play with Large Language Models","created":"2023-05-25","cited_by_count":294},{"id":"2204.02329","title":"Can language models learn from explanations in context?","created":"2022-04-05","cited_by_count":249},{"id":"2212.09196","title":"Emergent Analogical Reasoning in Large Language Models","created":"2022-12-19","cited_by_count":240},{"id":"2305.14160","title":"Label Words are Anchors: An Information Flow Perspective for Understanding In-Context Learning","created":"2023-05-23","cited_by_count":236},{"id":"2005.07648","title":"Language Conditioned Imitation Learning over Unstructured Data","created":"2020-05-15","cited_by_count":209},{"id":"2404.11018","title":"Many-Shot In-Context Learning","created":"2024-04-17","cited_by_count":206},{"id":"2210.14215","title":"In-context Reinforcement Learning with Algorithm Distillation","created":"2022-10-25","cited_by_count":190},{"id":"2205.10782","title":"Instruction Induction: From Few Examples to Natural Language Task Descriptions","created":"2022-05-22","cited_by_count":152},{"id":"2305.09731","title":"What In-Context Learning \"Learns\" In-Context: Disentangling Task Recognition and Task Learning","created":"2023-05-16","cited_by_count":152},{"id":"2308.13067","title":"Causal Parrots: Large Language Models May Talk Causality But Are Not Causal","created":"2023-08-24","cited_by_count":150},{"id":"2306.15063","title":"Pretraining task diversity and the emergence of non-Bayesian in-context learning for regression","created":"2023-06-26","cited_by_count":146},{"id":"2301.07608","title":"Human-Timescale Adaptation in an Open-Ended Task Space","created":"2023-01-18","cited_by_count":138},{"id":"2405.00200","title":"In-Context Learning with Long-Context Models: An In-Depth Exploration","created":"2024-04-30","cited_by_count":128},{"id":"2402.14903","title":"Tokenization counts: the impact of tokenization on arithmetic in frontier LLMs","created":"2024-02-22","cited_by_count":115},{"id":"1912.02877","title":"Training Agents using Upside-Down Reinforcement Learning","created":"2019-12-05","cited_by_count":107},{"id":"2307.11046","title":"A Definition of Continual Reinforcement Learning","created":"2023-07-20","cited_by_count":101},{"id":"1912.03820","title":"Meta-Learning without Memorization","created":"2019-12-09","cited_by_count":92},{"id":"2111.08284","title":"Few-Shot Self-Rationalization with Natural Language Prompts","created":"2021-11-16","cited_by_count":83},{"id":"2311.08360","title":"The Transient Nature of Emergent In-Context Learning in Transformers","created":"2023-11-14","cited_by_count":76},{"id":"1905.03030","title":"Meta-learning of Sequential Strategies","created":"2019-05-08","cited_by_count":70},{"id":"2403.19827","title":"Language Models Learn Rare Phenomena from Less Rare Phenomena: The Case of the Missing AANNs","created":"2024-03-28","cited_by_count":65},{"id":"2310.03016","title":"Understanding In-Context Learning in Transformers and LLMs by Learning to Learn Discrete Functions","created":"2023-10-04","cited_by_count":63},{"id":"2305.12907","title":"Meta-in-context learning in large language models","created":"2023-05-22","cited_by_count":59},{"id":"2009.01719","title":"Grounded Language Learning Fast and Slow","created":"2020-09-03","cited_by_count":54},{"id":"2412.01003","title":"Competition Dynamics Shape Algorithmic Phases of In-Context Learning","created":"2024-12-01","cited_by_count":54},{"id":"1901.08162","title":"Causal Reasoning from Meta-reinforcement Learning","created":"2019-01-23","cited_by_count":53},{"id":"1506.04089","title":"Listen, Attend, and Walk: Neural Mapping of Navigational Instructions to Action Sequences","created":"2015-06-12","cited_by_count":50},{"id":"1910.00571","title":"Environmental drivers of systematicity and generalization in a situated agent","created":"2019-10-01","cited_by_count":50},{"id":"2210.05675","title":"Transformers generalize differently from information stored in context vs in weights","created":"2022-10-11","cited_by_count":49},{"id":"2109.14989","title":"Structural Persistence in Language Models: Priming as a Window into Abstract Language Representations","created":"2021-09-30","cited_by_count":44},{"id":"2306.15091","title":"Understanding In-Context Learning via Supportive Pretraining Data","created":"2023-06-26","cited_by_count":41},{"id":"2011.13464","title":"Meta-learning in natural and artificial intelligence","created":"2020-11-26","cited_by_count":39},{"id":"2102.02926","title":"Alchemy: A benchmark and analysis toolkit for meta-reinforcement learning agents","created":"2021-02-04","cited_by_count":36},{"id":"2411.14215","title":"Evaluating the Robustness of Analogical Reasoning in Large Language Models","created":"2024-11-21","cited_by_count":31},{"id":"2310.00297","title":"Understanding In-Context Learning from Repetitions","created":"2023-09-30","cited_by_count":29},{"id":"2402.12530","title":"Parallel Structures in Pre-training Data Yield In-Context Learning","created":"2024-02-19","cited_by_count":26},{"id":"2311.12997","title":"Compositional Capabilities of Autoregressive Transformers: A Study on Synthetic, Interpretable Tasks","created":"2023-11-21","cited_by_count":22},{"id":"2305.16183","title":"Passive learning of active causal strategies in agents and language models","created":"2023-05-25","cited_by_count":21},{"id":"2410.01774","title":"Trained Transformer Classifiers Generalize and Exhibit Benign Overfitting In-Context","created":"2024-10-02","cited_by_count":15},{"id":"2307.01201","title":"Schema-learning and rebinding as mechanisms of in-context learning and emergence","created":"2023-06-16","cited_by_count":14},{"id":"2404.13070","title":"Evidence from counterfactual tasks supports emergent analogical reasoning in large language models","created":"2024-04-14","cited_by_count":14},{"id":"2302.03353","title":"What do Language Models know about word senses? Zero-Shot WSD with Language Models and Domain Inventories","created":"2023-02-07","cited_by_count":9},{"id":"2403.01518","title":"Revisiting Dynamic Evaluation: Online Adaptation for Large Language Models","created":"2024-03-03","cited_by_count":7}],"next_cursor":null}