{"list":"other","total":67,"rows":[{"id":"1706.03762","title":"Attention Is All You Need","created":"2017-06-12","cited_by_count":60361},{"id":"1810.04805","title":"BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding","created":"2018-10-11","cited_by_count":40399},{"id":"2001.08361","title":"Scaling Laws for Neural Language Models","created":"2020-01-23","cited_by_count":6586},{"id":"1804.07461","title":"GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understanding","created":"2018-04-20","cited_by_count":4899},{"id":"2304.01373","title":"Pythia: A Suite for Analyzing Large Language Models Across Training and Scaling","created":"2023-04-03","cited_by_count":1786},{"id":"1905.00537","title":"SuperGLUE: A Stickier Benchmark for General-Purpose Language Understanding Systems","created":"2019-05-02","cited_by_count":1729},{"id":"2311.05232","title":"A Survey on Hallucination in Large Language Models: Principles, Taxonomy, Challenges, and Open Questions","created":"2023-11-09","cited_by_count":1601},{"id":"1803.10122","title":"World Models","created":"2018-03-27","cited_by_count":1513},{"id":"1609.08144","title":"Google's Neural Machine Translation System: Bridging the Gap between Human and Machine Translation","created":"2016-09-26","cited_by_count":1475},{"id":"1905.05950","title":"BERT Rediscovers the Classical NLP Pipeline","created":"2019-05-15","cited_by_count":1059},{"id":"2310.01798","title":"Large Language Models Cannot Self-Correct Reasoning Yet","created":"2023-10-03","cited_by_count":1017},{"id":"2112.00114","title":"Show Your Work: Scratchpads for Intermediate Computation with Language Models","created":"2021-11-30","cited_by_count":886},{"id":"1410.5401","title":"Neural Turing Machines","created":"2014-10-20","cited_by_count":644},{"id":"2203.14680","title":"Transformer Feed-Forward Layers Build Predictions by Promoting Concepts in the Vocabulary Space","created":"2022-03-28","cited_by_count":532},{"id":"2304.15004","title":"Are Emergent Abilities of Large Language Models a Mirage?","created":"2023-04-28","cited_by_count":523},{"id":"2212.14052","title":"Hungry Hungry Hippos: Towards Language Modeling with State Space Models","created":"2022-12-28","cited_by_count":499},{"id":"2305.12295","title":"Logic-LM: Empowering Large Language Models with Symbolic Solvers for Faithful Logical Reasoning","created":"2023-05-20","cited_by_count":391},{"id":"2111.15366","title":"AI and the Everything in the Whole Wide World Benchmark","created":"2021-11-26","cited_by_count":349},{"id":"2210.01240","title":"Language Models Are Greedy Reasoners: A Systematic Formal Analysis of Chain-of-Thought","created":"2022-10-03","cited_by_count":337},{"id":"2401.11817","title":"Hallucination is Inevitable: An Innate Limitation of Large Language Models","created":"2024-01-22","cited_by_count":332},{"id":"2305.15408","title":"Towards Revealing the Mystery behind Chain of Thought: A Theoretical Perspective","created":"2023-05-24","cited_by_count":294},{"id":"1906.06755","title":"Theoretical Limitations of Self-Attention in Neural Sequence Models","created":"2019-06-16","cited_by_count":288},{"id":"2012.05876","title":"Neurosymbolic AI: The 3rd Wave","created":"2020-12-10","cited_by_count":255},{"id":"1911.03343","title":"Negated and Misprimed Probes for Pretrained Language Models: Birds Can Talk, But Cannot Fly","created":"2019-11-08","cited_by_count":243},{"id":"2207.02098","title":"Neural Networks and the Chomsky Hierarchy","created":"2022-07-05","cited_by_count":217},{"id":"2312.04927","title":"Zoology: Measuring and Improving Recall in Efficient Language Models","created":"2023-12-08","cited_by_count":204},{"id":"2207.00729","title":"The Parallelism Tradeoff: Limitations of Log-Precision Transformers","created":"2022-07-02","cited_by_count":193},{"id":"2106.06981","title":"Thinking Like Transformers","created":"2021-06-13","cited_by_count":184},{"id":"2402.01817","title":"LLMs Can't Plan, But Can Help Planning in LLM-Modulo Frameworks","created":"2024-02-02","cited_by_count":179},{"id":"2211.05110","title":"Large Language Models with Controllable Working Memory","created":"2022-11-09","cited_by_count":169},{"id":"2306.02896","title":"Representational Strengths and Limitations of Transformers","created":"2023-06-05","cited_by_count":133},{"id":"1901.03429","title":"On the Turing Completeness of Modern Neural Network Architectures","created":"2019-01-10","cited_by_count":129},{"id":"2311.00208","title":"What Formal Languages Can Transformers Express? A Survey","created":"2023-11-01","cited_by_count":124},{"id":"1805.04908","title":"On the Practical Computational Power of Finite Precision RNNs for Language Recognition","created":"2018-05-13","cited_by_count":117},{"id":"2411.12990","title":"BetterBench: Assessing AI Benchmarks, Uncovering Issues, and Establishing Best Practices","created":"2024-11-20","cited_by_count":114},{"id":"2202.12172","title":"Overcoming a Theoretical Limitation of Self-Attention","created":"2022-02-24","cited_by_count":113},{"id":"2502.12143","title":"Small Models Struggle to Learn from Strong Reasoners","created":"2025-02-17","cited_by_count":113},{"id":"2105.11115","title":"Self-Attention Networks Can Process Bounded Hierarchical Languages","created":"2021-05-24","cited_by_count":105},{"id":"2202.12299","title":"Capturing Failures of Large Language Models via Human Cognitive Biases","created":"2022-02-24","cited_by_count":98},{"id":"2410.21272","title":"Arithmetic Without Algorithms: Language Models Solve Math With a Bag of Heuristics","created":"2024-10-28","cited_by_count":97},{"id":"2303.11504","title":"Language Model Behavior: A Comprehensive Survey","created":"2023-03-20","cited_by_count":92},{"id":"2006.09286","title":"On the Computational Power of Transformers and its Implications in Sequence Modeling","created":"2020-06-16","cited_by_count":85},{"id":"2305.13673","title":"Physics of Language Models: Part 1, Learning Hierarchical Language Structures","created":"2023-05-23","cited_by_count":83},{"id":"2403.04121","title":"Can Large Language Models Reason and Plan?","created":"2024-03-07","cited_by_count":82},{"id":"2312.14890","title":"NPHardEval: Dynamic Benchmark on Reasoning Ability of Large Language Models via Complexity Classes","created":"2023-12-22","cited_by_count":79},{"id":"2306.00946","title":"Exposing Attention Glitches with Flip-Flop Language Modeling","created":"2023-06-01","cited_by_count":75},{"id":"2406.11050","title":"A Peek into Token Bias: Large Language Models Are Not Yet Genuine Reasoners","created":"2024-06-16","cited_by_count":73},{"id":"2010.06891","title":"Memformer: A Memory-Augmented Transformer for Sequence Modeling","created":"2020-10-14","cited_by_count":63},{"id":"2402.08164","title":"On Limitations of the Transformer Architecture","created":"2024-02-13","cited_by_count":63},{"id":"1906.01615","title":"Sequential Neural Networks as Automata","created":"2019-06-04","cited_by_count":54},{"id":"2310.13897","title":"Masked Hard-Attention Transformers Recognize Exactly the Star-Free Languages","created":"2023-10-21","cited_by_count":49},{"id":"2406.18219","title":"A Closer Look into Mixture-of-Experts in Large Language Models","created":"2024-06-26","cited_by_count":48},{"id":"2405.17394","title":"The Expressive Capacity of State Space Models: A Formal Language Perspective","created":"2024-05-27","cited_by_count":46},{"id":"1906.03648","title":"LSTM Networks Can Perform Dynamic Counting","created":"2019-06-09","cited_by_count":45},{"id":"2401.17671","title":"Contextual Feature Extraction Hierarchies Converge in Large Language Models and the Brain","created":"2024-01-31","cited_by_count":32},{"id":"2203.12258","title":"Can Prompt Probe Pretrained Language Models? Understanding the Invisible Risks from a Causal View","created":"2022-03-23","cited_by_count":31},{"id":"2402.03902","title":"A phase transition between positional and semantic learning in a solvable model of dot-product attention","created":"2024-02-06","cited_by_count":30},{"id":"2308.03212","title":"Average-Hard Attention Transformers are Constant-Depth Uniform Threshold Circuits","created":"2023-08-06","cited_by_count":26},{"id":"2408.12578","title":"A Percolation Model of Emergence: Analyzing Transformers Trained on a Formal Language","created":"2024-08-22","cited_by_count":26},{"id":"2412.03597","title":"The Vulnerability of Language Model Benchmarks: Do They Accurately Reflect True LLM Performance?","created":"2024-12-02","cited_by_count":22},{"id":"2004.06866","title":"On the Linguistic Capacity of Real-Time Counter Automata","created":"2020-04-15","cited_by_count":17},{"id":"2412.10827","title":"Rethinking Chain-of-Thought from the Perspective of Self-Training","created":"2024-12-14","cited_by_count":10},{"id":"1911.03024","title":"Why Do Masked Neural Language Models Still Need Common Sense Knowledge?","created":"2019-11-08","cited_by_count":7},{"id":"2008.05580","title":"Toward the quantification of cognition","created":"2020-08-12","cited_by_count":4},{"id":"1612.01150","title":"The grammar of mammalian brain capacity","created":"2016-12-04","cited_by_count":2},{"id":"2010.13870","title":"Word Frequency Does Not Predict Grammatical Knowledge in Language Models","created":"2020-10-26","cited_by_count":2},{"id":"2410.06547","title":"TuringQ: Benchmarking AI Comprehension in Theory of Computation","created":"2024-10-09","cited_by_count":2}],"next_cursor":null}