{"list":"other","total":63,"rows":[{"id":"1706.03762","title":"Attention Is All You Need","created":"2017-06-12","cited_by_count":60361},{"id":"1512.03385","title":"Deep Residual Learning for Image Recognition","created":"2015-12-10","cited_by_count":52096},{"id":"1810.04805","title":"BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding","created":"2018-10-11","cited_by_count":40399},{"id":"1912.01703","title":"PyTorch: An Imperative Style, High-Performance Deep Learning Library","created":"2019-12-03","cited_by_count":20305},{"id":"2201.11903","title":"Chain-of-Thought Prompting Elicits Reasoning in Large Language Models","created":"2022-01-28","cited_by_count":12459},{"id":"2107.03374","title":"Evaluating Large Language Models Trained on Code","created":"2021-07-07","cited_by_count":8320},{"id":"1910.01108","title":"DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lighter","created":"2019-10-02","cited_by_count":4307},{"id":"1910.03771","title":"HuggingFace's Transformers: State-of-the-art Natural Language Processing","created":"2019-10-09","cited_by_count":2218},{"id":"2004.07780","title":"Shortcut Learning in Deep Neural Networks","created":"2020-04-16","cited_by_count":1969},{"id":"1609.03499","title":"WaveNet: A Generative Model for Raw Audio","created":"2016-09-12","cited_by_count":1722},{"id":"1912.01603","title":"Dream to Control: Learning Behaviors by Latent Imagination","created":"2019-12-03","cited_by_count":1653},{"id":"2106.01345","title":"Decision Transformer: Reinforcement Learning via Sequence Modeling","created":"2021-06-02","cited_by_count":1546},{"id":"1609.08144","title":"Google's Neural Machine Translation System: Bridging the Gap between Human and Machine Translation","created":"2016-09-26","cited_by_count":1475},{"id":"2203.07814","title":"Competition-Level Code Generation with AlphaCode","created":"2022-02-08","cited_by_count":1462},{"id":"2104.13478","title":"Geometric Deep Learning: Grids, Groups, Graphs, Geodesics, and Gauges","created":"2021-04-27","cited_by_count":1167},{"id":"2108.12409","title":"Train Short, Test Long: Attention with Linear Biases Enables Input Length Extrapolation","created":"2021-08-27","cited_by_count":1103},{"id":"1905.05950","title":"BERT Rediscovers the Classical NLP Pipeline","created":"2019-05-15","cited_by_count":1059},{"id":"1906.04341","title":"What Does BERT Look At? An Analysis of BERT's Attention","created":"2019-06-11","cited_by_count":1003},{"id":"2112.00114","title":"Show Your Work: Scratchpads for Intermediate Computation with Language Models","created":"2021-11-30","cited_by_count":886},{"id":"1807.03819","title":"Universal Transformers","created":"2018-07-10","cited_by_count":647},{"id":"1410.5401","title":"Neural Turing Machines","created":"2014-10-20","cited_by_count":644},{"id":"2106.02039","title":"Offline Reinforcement Learning as One Big Sequence Modeling Problem","created":"2021-06-03","cited_by_count":644},{"id":"1603.08983","title":"Adaptive Computation Time for Recurrent Neural Networks","created":"2016-03-29","cited_by_count":506},{"id":"2102.10882","title":"Conditional Positional Encodings for Vision Transformers","created":"2021-02-22","cited_by_count":406},{"id":"2009.03393","title":"Generative Language Modeling for Automated Theorem Proving","created":"2020-09-07","cited_by_count":388},{"id":"2209.00588","title":"Transformers are Sample-Efficient World Models","created":"2022-09-01","cited_by_count":328},{"id":"1906.06755","title":"Theoretical Limitations of Self-Attention in Neural Sequence Models","created":"2019-06-16","cited_by_count":288},{"id":"1912.01412","title":"Deep Learning for Symbolic Mathematics","created":"2019-12-02","cited_by_count":270},{"id":"1602.04485","title":"Benefits of depth in neural networks","created":"2016-02-14","cited_by_count":250},{"id":"2111.00210","title":"Mastering Atari Games with Limited Data","created":"2021-10-30","cited_by_count":237},{"id":"2009.11848","title":"How Neural Networks Extrapolate: From Feedforward to Graph Neural Networks","created":"2020-09-24","cited_by_count":222},{"id":"2103.12731","title":"Scaling Local Self-Attention for Parameter Efficient Visual Backbones","created":"2021-03-23","cited_by_count":220},{"id":"2207.02098","title":"Neural Networks and the Chomsky Hierarchy","created":"2022-07-05","cited_by_count":217},{"id":"1605.07648","title":"FractalNet: Ultra-Deep Neural Networks without Residuals","created":"2016-05-24","cited_by_count":216},{"id":"2207.04901","title":"Exploring Length Generalization in Large Language Models","created":"2022-07-11","cited_by_count":206},{"id":"2006.15595","title":"Rethinking Positional Encoding in Language Pre-training","created":"2020-06-28","cited_by_count":197},{"id":"2010.04819","title":"How Does Mixup Help With Robustness and Generalization?","created":"2020-10-09","cited_by_count":193},{"id":"2207.08799","title":"Hidden Progress in Deep Learning: SGD Learns Parities Near the Computational Limit","created":"2022-07-18","cited_by_count":187},{"id":"2106.06981","title":"Thinking Like Transformers","created":"2021-06-13","cited_by_count":184},{"id":"1512.03965","title":"The Power of Depth for Feedforward Neural Networks","created":"2015-12-12","cited_by_count":183},{"id":"2203.16634","title":"Transformer Language Models without Positional Encodings Still Learn Positional Information","created":"2022-03-30","cited_by_count":150},{"id":"2110.10090","title":"Inductive Biases and Variable Creation in Self-Attention Mechanisms","created":"2021-10-19","cited_by_count":144},{"id":"2102.13019","title":"Investigating the Limitations of Transformers with Simple Arithmetic Tasks","created":"2021-02-25","cited_by_count":139},{"id":"2106.04537","title":"Can You Learn an Algorithm? Generalizing from Easy to Hard Problems with Recurrent Networks","created":"2021-06-08","cited_by_count":117},{"id":"2106.11230","title":"Can contrastive learning avoid shortcut solutions?","created":"2021-06-21","cited_by_count":114},{"id":"2206.04301","title":"Unveiling Transformers with LEGO: a synthetic reasoning task","created":"2022-06-09","cited_by_count":106},{"id":"2105.11115","title":"Self-Attention Networks Can Process Bounded Hierarchical Languages","created":"2021-05-24","cited_by_count":105},{"id":"2103.13076","title":"Finetuning Pretrained Transformers into RNNs","created":"2021-03-24","cited_by_count":96},{"id":"2112.15594","title":"A Neural Network Solves, Explains, and Generates University Math Problems by Program Synthesis and Few-Shot Learning at Human Level","created":"2021-12-31","cited_by_count":96},{"id":"2002.07400","title":"Learning Parities with Neural Networks","created":"2020-02-18","cited_by_count":78},{"id":"2204.09269","title":"A Survey on Non-Autoregressive Generation for Neural Machine Translation and Beyond","created":"2022-04-20","cited_by_count":64},{"id":"2105.14835","title":"Towards Lower Bounds on the Depth of ReLU Neural Networks","created":"2021-05-31","cited_by_count":56},{"id":"2010.04303","title":"How Can Self-Attention Networks Recognize Dyck-n Languages?","created":"2020-10-09","cited_by_count":51},{"id":"1702.08489","title":"Depth Separation for Neural Networks","created":"2017-02-27","cited_by_count":46},{"id":"2010.07174","title":"The EOS Decision and Length Extrapolation","created":"2020-10-14","cited_by_count":46},{"id":"1611.10258","title":"Reliably Learning the ReLU in Polynomial Time","created":"2016-11-30","cited_by_count":36},{"id":"2202.05826","title":"End-to-end Algorithm Synthesis with Recurrent Networks: Logical Extrapolation Without Overthinking","created":"2022-02-11","cited_by_count":33},{"id":"2107.12580","title":"Pointer Value Retrieval: A new benchmark for understanding the limits of neural network generalization","created":"2021-07-27","cited_by_count":29},{"id":"1904.06984","title":"Depth Separations in Neural Networks: What is Actually Being Separated?","created":"2019-04-15","cited_by_count":27},{"id":"1702.07028","title":"On the ability of neural nets to express distributions","created":"2017-02-22","cited_by_count":26},{"id":"2106.05784","title":"Programming Puzzles","created":"2021-06-10","cited_by_count":25},{"id":"1711.03073","title":"Lower bounds over Boolean inputs for deep neural networks with ReLU gates","created":"2017-11-08","cited_by_count":21},{"id":"2206.03688","title":"Identifying good directions to escape the NTK regime and efficiently learn low-degree plus sparse polynomials","created":"2022-06-08","cited_by_count":13}],"next_cursor":null}