{"total":53,"rows":[{"id":"2106.06981","title":"Thinking Like Transformers","created":"2021-06-13","cited_by_count":184,"area":null},{"id":"2106.16213","title":"Saturated Transformers are Constant-Depth Threshold Circuits","created":"2021-06-30","cited_by_count":139,"area":null},{"id":"2311.00208","title":"What Formal Languages Can Transformers Express? A Survey","created":"2023-11-01","cited_by_count":124,"area":null},{"id":"2105.11115","title":"Self-Attention Networks Can Process Bounded Hierarchical Languages","created":"2021-05-24","cited_by_count":105,"area":null},{"id":"2107.13163","title":"Statistically Meaningful Approximation: a Case Study on Approximating Turing Machines with Transformers","created":"2021-07-28","cited_by_count":102,"area":null},{"id":"2401.12973","title":"In-Context Language Learning: Architectures and Algorithms","created":"2024-01-23","cited_by_count":89,"area":null},{"id":"2303.04245","title":"How Do Transformers Learn Topic Structure: Towards a Mechanistic Understanding","created":"2023-03-07","cited_by_count":86,"area":null},{"id":"2403.17844","title":"Mechanistic Design and Scaling of Hybrid Architectures","created":"2024-03-26","cited_by_count":59,"area":null},{"id":"2501.17047","title":"How Linguistics Learned to Stop Worrying and Love the Language Models","created":"2025-01-28","cited_by_count":51,"area":null},{"id":"2405.17394","title":"The Expressive Capacity of State Space Models: A Formal Language Perspective","created":"2024-05-27","cited_by_count":46,"area":null},{"id":"2412.02975","title":"Theoretical limitations of multi-layer Transformer","created":"2024-12-04","cited_by_count":45,"area":null},{"id":"2401.06416","title":"Mission: Impossible Language Models","created":"2024-01-12","cited_by_count":32,"area":null},{"id":"2404.14994","title":"Transformers Can Represent $n$-gram Language Models","created":"2024-04-23","cited_by_count":32,"area":null},{"id":"2312.01429","title":"Transformers are uninterpretable with myopic methods: a case study with bounded Dyck grammars","created":"2023-12-03","cited_by_count":30,"area":null},{"id":"2406.09347","title":"Separations in the Representational Capabilities of Transformers and Recurrent Architectures","created":"2024-06-13","cited_by_count":29,"area":null},{"id":"2312.03656","title":"Interpretability Illusions in the Generalization of Simplified Models","created":"2023-12-06","cited_by_count":25,"area":null},{"id":"2405.05847","title":"Learned feature representations are biased by complexity, learning order, position, and more","created":"2024-05-09","cited_by_count":23,"area":null},{"id":"2406.04289","title":"What Languages are Easy to Language-Model? A Perspective from Learning Probabilistic Regular Languages","created":"2024-06-06","cited_by_count":20,"area":null},{"id":"2406.08787","title":"A Survey on Compositional Learning of AI Models: Theoretical and Experimental Practices","created":"2024-06-13","cited_by_count":15,"area":null},{"id":"2208.08195","title":"Benchmarking Compositionality with Formal Languages","created":"2022-08-17","cited_by_count":12,"area":null},{"id":"2402.12363","title":"Emergent Word Order Universals from Cognitively-Motivated Language Models","created":"2024-02-19","cited_by_count":11,"area":null},{"id":"2110.07240","title":"Causal Transformers Perform Below Chance on Recursive Nested Constructions, Unlike Humans","created":"2021-10-14","cited_by_count":8,"area":null},{"id":"2306.12181","title":"Feature Interactions Reveal Linguistic Structure in Language Models","created":"2023-06-21","cited_by_count":8,"area":null},{"id":"2112.09174","title":"Learning Bounded Context-Free-Grammar via LSTM and the Transformer:Difference and Explanations","created":"2021-12-16","cited_by_count":7,"area":null},{"id":"2310.05161","title":"Recurrent Neural Language Models as Probabilistic Finite-state Automata","created":"2023-10-08","cited_by_count":6,"area":null},{"id":"2106.01580","title":"The Limitations of Limited Context for Constituency Parsing","created":"2021-06-03","cited_by_count":5,"area":null},{"id":"2405.19222","title":"Lower Bounds on the Expressivity of Recurrent Neural Language Models","created":"2024-05-29","cited_by_count":4,"area":null},{"id":"2402.02627","title":"Stability Analysis of Various Symbolic Rule Extraction Methods from Recurrent Neural Network","created":"2024-02-04","cited_by_count":3,"area":null},{"id":"2605.00768","title":"Characterizing the Expressivity of Local Attention in Transformers","created":"2026-05-01","cited_by_count":3,"area":null},{"id":"2101.08200","title":"Synthesizing Context-free Grammars from Recurrent Neural Networks (Extended Version)","created":"2021-01-20","cited_by_count":2,"area":null},{"id":"2208.05719","title":"Assessing the Unitary RNN as an End-to-End Compositional Model of Syntax","created":"2022-08-11","cited_by_count":2,"area":null},{"id":"2309.00857","title":"Evaluating Transformer's Ability to Learn Mildly Context-Sensitive Languages","created":"2023-09-02","cited_by_count":2,"area":null},{"id":"2604.01577","title":"Exploration of Fast-Slow Latent Recurrence for Train-Short, Test-Long Generalization","created":"2026-04-02","cited_by_count":2,"area":null},{"id":"2301.06862","title":"Algorithms for Acyclic Weighted Finite-State Automata with Failure Arcs","created":"2023-01-17","cited_by_count":1,"area":null},{"id":"2310.12942","title":"On the Representational Capacity of Recurrent Neural Language Models","created":"2023-10-19","cited_by_count":1,"area":null},{"id":"2402.15814","title":"On Efficiently Representing Regular Languages as RNNs","created":"2024-02-24","cited_by_count":1,"area":null},{"id":"2602.01763","title":"A Provable Expressiveness Hierarchy in Hybrid Linear-Full Attention","created":"2026-02-02","cited_by_count":1,"area":null},{"id":"2604.17857","title":"On the Emergence of Syntax by Means of Local Interaction","created":"2026-04-20","cited_by_count":1,"area":null},{"id":"2410.03118","title":"Precision, Stability, and Generalization: A Comprehensive Assessment of RNNs learnability capability for Classifying Counter and Dyck Languages","created":"2024-10-04","cited_by_count":0,"area":null},{"id":"2508.07969","title":"Understanding Syntactic Generalization in Structure-inducing Language Models","created":"2025-08-11","cited_by_count":0,"area":null},{"id":"2510.08341","title":"Post-Norm can Resharpen Attention","created":"2025-10-09","cited_by_count":0,"area":null},{"id":"2512.09394","title":"Language models as tools for investigating the distinction between possible and impossible natural languages","created":"2025-12-10","cited_by_count":0,"area":null},{"id":"2512.12447","title":"Large language models have learned to use language","created":"2025-12-13","cited_by_count":0,"area":null},{"id":"2512.13441","title":"Large language models are not about natural language","created":"2025-12-15","cited_by_count":0,"area":null},{"id":"2512.14506","title":"Linguists should learn to love speech-based deep learning models","created":"2025-12-16","cited_by_count":0,"area":null},{"id":"2601.10421","title":"Are Language Models Models?","created":"2026-01-15","cited_by_count":0,"area":null},{"id":"2603.11332","title":"On the Computational Hardness of Transformers","created":"2026-03-11","cited_by_count":0,"area":null},{"id":"2604.05923","title":"The UNDO Flip-Flop: A Controlled Probe for Reversible Semantic State Management in State Space Model","created":"2026-04-07","cited_by_count":0,"area":null},{"id":"2604.09466","title":"Across the Levels of Analysis: Explaining Predictive Processing in Humans Requires More Than Machine-Estimated Probabilities","created":"2026-04-10","cited_by_count":0,"area":null},{"id":"2604.09501","title":"You Can't Fight in Here! This is BBS!","created":"2026-04-10","cited_by_count":0,"area":null},{"id":"2605.10061","title":"Not-So-Strange Love: Language Models and Generative Linguistic Theories are More Compatible than They Appear","created":"2026-05-11","cited_by_count":0,"area":null},{"id":"2606.00926","title":"Refit the Probe: Single-Direction Ablation Is Not a Necessity Test","created":"2026-05-30","cited_by_count":0,"area":null},{"id":"2606.09822","title":"Causally Evaluating the Learnability of Formal Language Tasks","created":"2026-06-08","cited_by_count":0,"area":null}],"next_cursor":null}