{"list":"other","total":115,"rows":[{"id":"2205.11916","title":"Large Language Models are Zero-Shot Reasoners","created":"2022-05-24","cited_by_count":4374},{"id":"1907.02893","title":"Invariant Risk Minimization","created":"2019-07-05","cited_by_count":1854},{"id":"2006.16241","title":"The Many Faces of Robustness: A Critical Analysis of Out-of-Distribution Generalization","created":"2020-06-29","cited_by_count":1850},{"id":"1806.09055","title":"DARTS: Differentiable Architecture Search","created":"2018-06-24","cited_by_count":1798},{"id":"2012.07421","title":"WILDS: A Benchmark of in-the-Wild Distribution Shifts","created":"2020-12-14","cited_by_count":1375},{"id":"1806.08734","title":"On the Spectral Bias of Neural Networks","created":"2018-06-22","cited_by_count":1341},{"id":"1802.07569","title":"Continual Lifelong Learning with Neural Networks: A Review","created":"2018-02-21","cited_by_count":1330},{"id":"1911.08731","title":"Distributionally Robust Neural Networks for Group Shifts: On the Importance of Regularization for Worst-Case Generalization","created":"2019-11-20","cited_by_count":1247},{"id":"1411.1792","title":"How transferable are features in deep neural networks?","created":"2014-11-06","cited_by_count":1225},{"id":"2007.01434","title":"In Search of Lost Domain Generalization","created":"2020-07-02","cited_by_count":1054},{"id":"2201.07207","title":"Language Models as Zero-Shot Planners: Extracting Actionable Knowledge for Embodied Agents","created":"2022-01-18","cited_by_count":1035},{"id":"1710.03077","title":"Deeper, Broader and Artier Domain Generalization","created":"2017-10-09","cited_by_count":986},{"id":"1802.03268","title":"Efficient Neural Architecture Search via Parameter Sharing","created":"2018-02-09","cited_by_count":837},{"id":"2003.00688","title":"Out-of-Distribution Generalization via Risk Extrapolation (REx)","created":"2020-03-02","cited_by_count":742},{"id":"2403.14608","title":"Parameter-Efficient Fine-Tuning for Large Models: A Comprehensive Survey","created":"2024-03-21","cited_by_count":656},{"id":"1807.03819","title":"Universal Transformers","created":"2018-07-10","cited_by_count":647},{"id":"1410.5401","title":"Neural Turing Machines","created":"2014-10-20","cited_by_count":644},{"id":"1301.2115","title":"Domain Generalization via Invariant Feature Representation","created":"2013-01-10","cited_by_count":623},{"id":"1912.02178","title":"Fantastic Generalization Measures and Where to Find Them","created":"2019-12-04","cited_by_count":513},{"id":"1603.08983","title":"Adaptive Computation Time for Recurrent Neural Networks","created":"2016-03-29","cited_by_count":506},{"id":"2305.18654","title":"Faith and Fate: Limits of Transformers on Compositionality","created":"2023-05-29","cited_by_count":503},{"id":"2310.07820","title":"Large Language Models Are Zero-Shot Time Series Forecasters","created":"2023-10-11","cited_by_count":500},{"id":"2002.08791","title":"Bayesian Deep Learning and a Probabilistic Perspective of Generalization","created":"2020-02-20","cited_by_count":480},{"id":"2007.07779","title":"AdapterHub: A Framework for Adapting Transformers","created":"2020-07-15","cited_by_count":444},{"id":"2206.14576","title":"Using cognitive psychology to understand GPT-3","created":"2022-06-21","cited_by_count":398},{"id":"1901.06523","title":"Frequency Principle: Fourier Analysis Sheds Light on Deep Neural Networks","created":"2019-01-19","cited_by_count":368},{"id":"2006.07710","title":"The Pitfalls of Simplicity Bias in Neural Networks","created":"2020-06-13","cited_by_count":351},{"id":"2305.19466","title":"The Impact of Positional Encoding on Length Generalization in Transformers","created":"2023-05-31","cited_by_count":327},{"id":"2304.01933","title":"LLM-Adapters: An Adapter Family for Parameter-Efficient Fine-Tuning of Large Language Models","created":"2023-04-04","cited_by_count":324},{"id":"1906.06755","title":"Theoretical Limitations of Self-Attention in Neural Sequence Models","created":"2019-06-16","cited_by_count":288},{"id":"2210.10749","title":"Transformers Learn Shortcuts to Automata","created":"2022-10-19","cited_by_count":268},{"id":"1802.08246","title":"Characterizing Implicit Bias in Terms of Optimization Geometry","created":"2018-02-22","cited_by_count":266},{"id":"2101.10382","title":"Curriculum Learning: A Survey","created":"2021-01-25","cited_by_count":259},{"id":"2103.09177","title":"Deep learning: a statistical viewpoint","created":"2021-03-16","cited_by_count":240},{"id":"1412.5687","title":"Towards Open World Recognition","created":"2014-12-18","cited_by_count":226},{"id":"2207.02098","title":"Neural Networks and the Chomsky Hierarchy","created":"2022-07-05","cited_by_count":217},{"id":"2310.16028","title":"What Algorithms can Transformers Learn? A Study in Length Generalization","created":"2023-10-24","cited_by_count":199},{"id":"2307.04721","title":"Large Language Models as General Pattern Machines","created":"2023-07-10","cited_by_count":197},{"id":"1711.00436","title":"Hierarchical Representations for Efficient Architecture Search","created":"2017-11-01","cited_by_count":191},{"id":"2312.03863","title":"Efficient Large Language Models: A Survey","created":"2023-12-06","cited_by_count":186},{"id":"1805.08522","title":"Deep learning generalizes because the parameter-function map is biased towards simple functions","created":"2018-05-22","cited_by_count":183},{"id":"1910.11858","title":"BANANAS: Bayesian Optimization with Neural Architectures for Neural Architecture Search","created":"2019-10-25","cited_by_count":179},{"id":"2309.13638","title":"Embers of Autoregression: Understanding Large Language Models Through the Problem They are Trained to Solve","created":"2023-09-24","cited_by_count":178},{"id":"2107.05407","title":"PonderNet: Learning to Ponder","created":"2021-07-12","cited_by_count":168},{"id":"2403.06963","title":"The pitfalls of next-token prediction","created":"2024-03-11","cited_by_count":160},{"id":"1804.09081","title":"Efficient Multi-objective Neural Architecture Search via Lamarckian Evolution","created":"2018-04-24","cited_by_count":153},{"id":"2008.10937","title":"A Survey on Evolutionary Neural Architecture Search","created":"2020-08-25","cited_by_count":142},{"id":"2102.13019","title":"Investigating the Limitations of Transformers with Simple Arithmetic Tasks","created":"2021-02-25","cited_by_count":139},{"id":"2301.08727","title":"Neural Architecture Search: Insights from 1000 Papers","created":"2023-01-20","cited_by_count":139},{"id":"2406.16838","title":"From Decoding to Meta-Generation: Inference-time Algorithms for Large Language Models","created":"2024-06-24","cited_by_count":137},{"id":"2009.00329","title":"Learning explanations that are hard to vary","created":"2020-09-01","cited_by_count":132},{"id":"2106.04537","title":"Can You Learn an Algorithm? Generalizing from Easy to Hard Problems with Recurrent Networks","created":"2021-06-08","cited_by_count":117},{"id":"2205.15659","title":"The CLRS Algorithmic Reasoning Benchmark","created":"2022-05-31","cited_by_count":106},{"id":"2105.11115","title":"Self-Attention Networks Can Process Bounded Hierarchical Languages","created":"2021-05-24","cited_by_count":105},{"id":"1511.06279","title":"Neural Programmer-Interpreters","created":"2015-11-19","cited_by_count":101},{"id":"2409.15647","title":"Looped Transformers for Length Generalization","created":"2024-09-24","cited_by_count":99},{"id":"1810.05546","title":"Uncertainty in Neural Networks: Approximately Bayesian Ensembling","created":"2018-10-12","cited_by_count":94},{"id":"2204.06618","title":"Formal Language Recognition by Hard Attention Transformers: Perspectives from Circuit Complexity","created":"2022-04-13","cited_by_count":93},{"id":"2106.06295","title":"Going Beyond Linear Transformers with Recurrent Fast Weight Programmers","created":"2021-06-11","cited_by_count":89},{"id":"2009.01797","title":"A Wholistic View of Continual Learning with Deep Neural Networks: Forgotten Lessons and the Bridge to Active and Open World Learning","created":"2020-09-03","cited_by_count":87},{"id":"2211.12701","title":"Continual Learning of Natural Language Processing Tasks: A Survey","created":"2022-11-23","cited_by_count":83},{"id":"2402.09268","title":"Transformers, parallel computation, and logarithmic depth","created":"2024-02-14","cited_by_count":79},{"id":"2301.13105","title":"Generalization on the Unseen, Logic Reasoning and Degree Curriculum","created":"2023-01-30","cited_by_count":73},{"id":"2211.12316","title":"Simplicity Bias in Transformers and their Ability to Learn Sparse Boolean Functions","created":"2022-11-22","cited_by_count":70},{"id":"2001.10995","title":"The Case for Bayesian Deep Learning","created":"2020-01-29","cited_by_count":69},{"id":"2309.06979","title":"Auto-Regressive Next-Token Predictors are Universal Learners","created":"2023-09-13","cited_by_count":67},{"id":"2306.15400","title":"Length Generalization in Arithmetic Transformers","created":"2023-06-27","cited_by_count":66},{"id":"2310.14540","title":"Evaluating Spatial Understanding of Large Language Models","created":"2023-10-23","cited_by_count":66},{"id":"2406.06391","title":"Towards Lifelong Learning of Large Language Models: A Survey","created":"2024-06-10","cited_by_count":64},{"id":"2402.00809","title":"Position: Bayesian Deep Learning is Needed in the Age of Large-Scale AI","created":"2024-02-01","cited_by_count":62},{"id":"2310.11604","title":"Language Models as Zero-Shot Trajectory Generators","created":"2023-10-17","cited_by_count":60},{"id":"2010.11939","title":"Limitations of Autoregressive Models and Their Alternatives","created":"2020-10-22","cited_by_count":55},{"id":"1906.01615","title":"Sequential Neural Networks as Automata","created":"2019-06-04","cited_by_count":54},{"id":"2010.04303","title":"How Can Self-Attention Networks Recognize Dyck-n Languages?","created":"2020-10-09","cited_by_count":51},{"id":"2010.07174","title":"The EOS Decision and Length Extrapolation","created":"2020-10-14","cited_by_count":46},{"id":"2311.05965","title":"Large Language Models are Zero Shot Hypothesis Proposers","created":"2023-11-10","cited_by_count":45},{"id":"2204.02892","title":"Sub-Task Decomposition Enables Learning in Sequence to Sequence Tasks","created":"2022-04-06","cited_by_count":41},{"id":"2409.10502","title":"Causal Language Modeling Can Elicit Search and Reasoning Capabilities on Logic Puzzles","created":"2024-09-16","cited_by_count":38},{"id":"2307.04345","title":"Continual Learning as Computationally Constrained Reinforcement Learning","created":"2023-07-10","cited_by_count":37},{"id":"2406.06467","title":"How Far Can Transformers Reason? The Globality Barrier and Inductive Scratchpad","created":"2024-06-10","cited_by_count":36},{"id":"1704.06611","title":"Making Neural Programming Architectures Generalize via Recursion","created":"2017-04-21","cited_by_count":35},{"id":"1906.06349","title":"On the Computational Power of RNNs","created":"2019-06-14","cited_by_count":35},{"id":"1911.03872","title":"Location Attention for Extrapolation to Longer Sequences","created":"2019-11-10","cited_by_count":33},{"id":"2401.14953","title":"Learning Universal Predictors","created":"2024-01-26","cited_by_count":31},{"id":"2109.13986","title":"Symbolic Brittleness in Sequence Models: on Systematic Generalization in Symbolic Mathematics","created":"2021-09-28","cited_by_count":27},{"id":"2405.20131","title":"Language Models Need Inductive Biases to Count Inductively","created":"2024-05-30","cited_by_count":25},{"id":"2407.03310","title":"Universal Length Generalization with Turing Programs","created":"2024-07-03","cited_by_count":25},{"id":"1711.06301","title":"One Model for the Learning of Language","created":"2017-11-16","cited_by_count":22},{"id":"2011.03965","title":"On the Practical Ability of Recurrent Neural Networks to Recognize Hierarchical Languages","created":"2020-11-08","cited_by_count":22},{"id":"2402.04875","title":"On Provable Length and Compositional Generalization","created":"2024-02-07","cited_by_count":22},{"id":"1709.10380","title":"An Empirical Evaluation of Rule Extraction from Recurrent Neural Networks","created":"2017-09-29","cited_by_count":21},{"id":"2001.10913","title":"MEMO: A Deep Network for Flexible Combination of Episodic Memories","created":"2020-01-29","cited_by_count":21},{"id":"2211.11719","title":"First Steps Toward Understanding the Extrapolation of Nonlinear Models to Unseen Domains","created":"2022-11-21","cited_by_count":21},{"id":"2405.01964","title":"Position: Understanding LLMs Requires More Than Statistical Generalization","created":"2024-05-03","cited_by_count":21},{"id":"2304.14329","title":"Learning to Extrapolate: A Transductive Approach","created":"2023-04-27","cited_by_count":19},{"id":"2310.19089","title":"Pushdown Layers: Encoding Recursive Structure in Transformer Language Models","created":"2023-10-29","cited_by_count":19},{"id":"2412.04703","title":"Transformers Struggle to Learn to Search","created":"2024-12-06","cited_by_count":19},{"id":"2201.12451","title":"Extracting Finite Automata from RNNs Using State Merging","created":"2022-01-28","cited_by_count":17},{"id":"2305.14699","title":"Can Transformers Learn to Solve Problems Recursively?","created":"2023-05-24","cited_by_count":17},{"id":"2410.03170","title":"Autoregressive Large Language Models are Computationally Universal","created":"2024-10-04","cited_by_count":15}],"next_cursor":"100"}