{"list":"other","total":77,"rows":[{"id":"1706.03762","title":"Attention Is All You Need","created":"2017-06-12","cited_by_count":60361},{"id":"2005.14165","title":"Language Models are Few-Shot Learners","created":"2020-05-28","cited_by_count":32419},{"id":"2303.08774","title":"GPT-4 Technical Report","created":"2023-03-15","cited_by_count":18396},{"id":"2201.11903","title":"Chain-of-Thought Prompting Elicits Reasoning in Large Language Models","created":"2022-01-28","cited_by_count":12459},{"id":"2203.11171","title":"Self-Consistency Improves Chain of Thought Reasoning in Language Models","created":"2022-03-21","cited_by_count":5708},{"id":"2104.09864","title":"RoFormer: Enhanced Transformer with Rotary Position Embedding","created":"2021-04-20","cited_by_count":4703},{"id":"1409.0473","title":"Neural Machine Translation by Jointly Learning to Align and Translate","created":"2014-09-01","cited_by_count":4548},{"id":"2210.08402","title":"LAION-5B: An open large-scale dataset for training next generation image-text models","created":"2022-10-16","cited_by_count":4152},{"id":"1910.03771","title":"HuggingFace's Transformers: State-of-the-art Natural Language Processing","created":"2019-10-09","cited_by_count":2218},{"id":"2202.03629","title":"Survey of Hallucination in Natural Language Generation","created":"2022-02-08","cited_by_count":2075},{"id":"2006.16236","title":"Transformers are RNNs: Fast Autoregressive Transformers with Linear Attention","created":"2020-06-29","cited_by_count":2022},{"id":"2206.04615","title":"Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language models","created":"2022-06-09","cited_by_count":1998},{"id":"1909.01066","title":"Language Models as Knowledge Bases?","created":"2019-09-03","cited_by_count":1936},{"id":"1901.02860","title":"Transformer-XL: Attentive Language Models Beyond a Fixed-Length Context","created":"2019-01-09","cited_by_count":1850},{"id":"2002.05202","title":"GLU Variants Improve Transformer","created":"2020-02-12","cited_by_count":1804},{"id":"1609.08144","title":"Google's Neural Machine Translation System: Bridging the Gap between Human and Machine Translation","created":"2016-09-26","cited_by_count":1475},{"id":"2011.01060","title":"Constructing A Multi-hop QA Dataset for Comprehensive Evaluation of Reasoning Steps","created":"2020-11-02","cited_by_count":1282},{"id":"2108.12409","title":"Train Short, Test Long: Attention with Linear Biases Enables Input Length Extrapolation","created":"2021-08-27","cited_by_count":1103},{"id":"1508.04025","title":"Effective Approaches to Attention-based Neural Machine Translation","created":"2015-08-17","cited_by_count":1026},{"id":"1902.10186","title":"Attention is not Explanation","created":"2019-02-26","cited_by_count":929},{"id":"2112.00114","title":"Show Your Work: Scratchpads for Intermediate Computation with Language Models","created":"2021-11-30","cited_by_count":886},{"id":"2302.00093","title":"Large Language Models Can Be Easily Distracted by Irrelevant Context","created":"2023-01-31","cited_by_count":841},{"id":"2305.13048","title":"RWKV: Reinventing RNNs for the Transformer Era","created":"2023-05-22","cited_by_count":827},{"id":"1911.00172","title":"Generalization through Memorization: Nearest Neighbor Language Models","created":"2019-11-01","cited_by_count":800},{"id":"2208.01066","title":"What Can Transformers Learn In-Context? A Case Study of Simple Function Classes","created":"2022-08-01","cited_by_count":715},{"id":"2011.04006","title":"Long Range Arena: A Benchmark for Efficient Transformers","created":"2020-11-08","cited_by_count":700},{"id":"1807.03819","title":"Universal Transformers","created":"2018-07-10","cited_by_count":647},{"id":"1410.5401","title":"Neural Turing Machines","created":"2014-10-20","cited_by_count":644},{"id":"2212.14052","title":"Hungry Hungry Hippos: Towards Language Modeling with State Space Models","created":"2022-12-28","cited_by_count":499},{"id":"2305.07759","title":"TinyStories: How Small Can Language Models Be and Still Speak Coherent English?","created":"2023-05-12","cited_by_count":449},{"id":"2303.06349","title":"Resurrecting Recurrent Neural Networks for Long Sequences","created":"2023-03-11","cited_by_count":408},{"id":"2109.05052","title":"Entity-Based Knowledge Conflicts in Question Answering","created":"2021-09-10","cited_by_count":356},{"id":"1611.01368","title":"Assessing the Ability of LSTMs to Learn Syntax-Sensitive Dependencies","created":"2016-11-04","cited_by_count":354},{"id":"2210.01240","title":"Language Models Are Greedy Reasoners: A Systematic Formal Analysis of Chain-of-Thought","created":"2022-10-03","cited_by_count":337},{"id":"2205.09712","title":"Selection-Inference: Exploiting Large Language Models for Interpretable Logical Reasoning","created":"2022-05-19","cited_by_count":334},{"id":"2012.13048","title":"ProofWriter: Generating Implications, Proofs, and Abductive Statements over Natural Language","created":"2020-12-24","cited_by_count":324},{"id":"2305.13534","title":"How Language Model Hallucinations Can Snowball","created":"2023-05-22","cited_by_count":311},{"id":"1906.06755","title":"Theoretical Limitations of Self-Attention in Neural Sequence Models","created":"2019-06-16","cited_by_count":288},{"id":"2004.14373","title":"ToTTo: A Controlled Table-To-Text Generation Dataset","created":"2020-04-29","cited_by_count":268},{"id":"2210.10749","title":"Transformers Learn Shortcuts to Automata","created":"2022-10-19","cited_by_count":268},{"id":"2112.07916","title":"LongT5: Efficient Text-To-Text Transformer for Long Sequences","created":"2021-12-15","cited_by_count":232},{"id":"2203.08913","title":"Memorizing Transformers","created":"2022-03-16","cited_by_count":226},{"id":"2207.04901","title":"Exploring Length Generalization in Large Language Models","created":"2022-07-11","cited_by_count":206},{"id":"2207.08799","title":"Hidden Progress in Deep Learning: SGD Learns Parities Near the Computational Limit","created":"2022-07-18","cited_by_count":187},{"id":"2203.16634","title":"Transformer Language Models without Positional Encodings Still Learn Positional Information","created":"2022-03-30","cited_by_count":150},{"id":"2304.09797","title":"Progressive-Hint Prompting Improves Reasoning in Large Language Models","created":"2023-04-19","cited_by_count":147},{"id":"2110.10090","title":"Inductive Biases and Variable Creation in Self-Attention Mechanisms","created":"2021-10-19","cited_by_count":144},{"id":"2102.13019","title":"Investigating the Limitations of Transformers with Simple Arithmetic Tasks","created":"2021-02-25","cited_by_count":139},{"id":"2204.07931","title":"On the Origin of Hallucinations in Conversational Models: Is it the Datasets or the Models?","created":"2022-04-17","cited_by_count":138},{"id":"2305.01625","title":"Unlimiformer: Long-Range Transformers with Unlimited Length Input","created":"2023-05-02","cited_by_count":128},{"id":"1906.01081","title":"Handling Divergent Reference Texts when Evaluating Table-to-Text Generation","created":"2019-06-03","cited_by_count":119},{"id":"1805.04623","title":"Sharp Nearby, Fuzzy Far Away: How Neural Language Models Use Context","created":"2018-05-12","cited_by_count":113},{"id":"2202.12172","title":"Overcoming a Theoretical Limitation of Self-Attention","created":"2022-02-24","cited_by_count":113},{"id":"2211.09066","title":"Teaching Algorithmic Reasoning via In-context Learning","created":"2022-11-15","cited_by_count":112},{"id":"2104.08455","title":"Neural Path Hunter: Reducing Hallucination in Dialogue Systems via Path Grounding","created":"2021-04-17","cited_by_count":106},{"id":"2206.04301","title":"Unveiling Transformers with LEGO: a synthetic reasoning task","created":"2022-06-09","cited_by_count":106},{"id":"2105.11115","title":"Self-Attention Networks Can Process Bounded Hierarchical Languages","created":"2021-05-24","cited_by_count":105},{"id":"2107.13163","title":"Statistically Meaningful Approximation: a Case Study on Approximating Turing Machines with Transformers","created":"2021-07-28","cited_by_count":102},{"id":"2104.07143","title":"An Interpretability Illusion for BERT","created":"2021-04-14","cited_by_count":97},{"id":"2210.09221","title":"Vision Transformers provably learn spatial structure","created":"2022-10-13","cited_by_count":93},{"id":"2109.09115","title":"Do Long-Range Language Models Actually Use Long-Range Context?","created":"2021-09-19","cited_by_count":92},{"id":"2303.04245","title":"How Do Transformers Learn Topic Structure: Towards a Mechanistic Understanding","created":"2023-03-07","cited_by_count":86},{"id":"2104.09061","title":"Improving Faithfulness in Abstractive Summarization with Contrast Candidate Generation and Selection","created":"2021-04-19","cited_by_count":76},{"id":"2207.09238","title":"Formal Algorithms for Transformers","created":"2022-07-19","cited_by_count":72},{"id":"1910.08684","title":"Sticking to the Facts: Confident Decoding for Faithful Data-to-Text Generation","created":"2019-10-19","cited_by_count":62},{"id":"2302.00618","title":"Synthetic Prompting: Generating Chain-of-Thought Demonstrations for Large Language Models","created":"2023-02-01","cited_by_count":61},{"id":"2303.08117","title":"Do Transformers Parse while Predicting the Masked Word?","created":"2023-03-14","cited_by_count":48},{"id":"2101.06223","title":"LIME: Learning Inductive Bias for Primitives of Mathematical Reasoning","created":"2021-01-15","cited_by_count":46},{"id":"2006.00555","title":"Transferring Inductive Biases through Knowledge Distillation","created":"2020-05-31","cited_by_count":41},{"id":"2110.08294","title":"Coherence boosting: When your pretrained language model is not paying enough attention","created":"2021-10-15","cited_by_count":38},{"id":"1905.10617","title":"Exposure Bias versus Self-Recovery: Are Distortions Really Incremental for Autoregressive Text Generation?","created":"2019-05-25","cited_by_count":35},{"id":"2105.06548","title":"Not All Memories are Created Equal: Learning to Forget by Expiring","created":"2021-05-13","cited_by_count":32},{"id":"2106.01087","title":"Is Sparse Attention more Interpretable?","created":"2021-06-02","cited_by_count":31},{"id":"2305.00833","title":"Learning to Reason and Memorize with Self-Notes","created":"2023-05-01","cited_by_count":30},{"id":"2107.12580","title":"Pointer Value Retrieval: A new benchmark for understanding the limits of neural network generalization","created":"2021-07-27","cited_by_count":29},{"id":"2305.15507","title":"The Larger They Are, the Harder They Fail: Language Models do not Recognize Identifier Swaps in Python","created":"2023-05-24","cited_by_count":29},{"id":"2304.07687","title":"MLRegTest: A Benchmark for the Machine Learning of Regular Languages","created":"2023-04-16","cited_by_count":7}],"next_cursor":null}