{"total":59,"rows":[{"id":"2309.14316","title":"Physics of Language Models: Part 3.1, Knowledge Storage and Extraction","created":"2023-09-25","cited_by_count":270,"area":null},{"id":"2404.05405","title":"Physics of Language Models: Part 3.3, Knowledge Capacity Scaling Laws","created":"2024-04-08","cited_by_count":144,"area":null},{"id":"2309.14402","title":"Physics of Language Models: Part 3.2, Knowledge Manipulation","created":"2023-09-25","cited_by_count":143,"area":null},{"id":"2311.12786","title":"Mechanistically analyzing the effects of fine-tuning on procedurally defined tasks","created":"2023-11-21","cited_by_count":115,"area":null},{"id":"2501.17047","title":"How Linguistics Learned to Stop Worrying and Love the Language Models","created":"2025-01-28","cited_by_count":51,"area":null},{"id":"2501.00070","title":"ICLR: In-Context Learning of Representations","created":"2024-12-29","cited_by_count":50,"area":null},{"id":"2412.02975","title":"Theoretical limitations of multi-layer Transformer","created":"2024-12-04","cited_by_count":45,"area":null},{"id":"2512.17351","title":"Physics of Language Models: Part 4.1, Architecture Design and the Magic of Canon Layers","created":"2025-12-19","cited_by_count":33,"area":null},{"id":"2408.12578","title":"A Percolation Model of Emergence: Analyzing Transformers Trained on a Formal Language","created":"2024-08-22","cited_by_count":26,"area":null},{"id":"2402.00522","title":"Understanding the Expressive Power and Mechanisms of Transformer for Sequence Modeling","created":"2024-02-01","cited_by_count":25,"area":null},{"id":"2404.16367","title":"Learning Syntax Without Planting Trees: Understanding Hierarchical Generalization in Transformers","created":"2024-04-25","cited_by_count":24,"area":null},{"id":"2408.07144","title":"Language Models as Models of Language","created":"2024-08-13","cited_by_count":24,"area":null},{"id":"2602.07488","title":"Deriving Neural Scaling Laws from the statistics of natural language","created":"2026-02-07","cited_by_count":23,"area":null},{"id":"2505.07067","title":"Learning curves theory for hierarchically compositional data with power-law distributed features","created":"2025-05-11","cited_by_count":17,"area":null},{"id":"2410.05464","title":"Progressive distillation induces an implicit curriculum","created":"2024-10-07","cited_by_count":15,"area":null},{"id":"2511.05295","title":"Language Generation and Identification From Partial Enumeration: Tight Density Bounds and Topological Characterizations","created":"2025-11-07","cited_by_count":13,"area":null},{"id":"2512.18792","title":"The Dead Salmons of AI Interpretability","created":"2025-12-21","cited_by_count":12,"area":null},{"id":"2410.21698","title":"On the Role of Depth and Looping for In-Context Learning with Task Diversity","created":"2024-10-29","cited_by_count":11,"area":null},{"id":"2505.14172","title":"The Strawberry Problem: Emergence of Character-level Understanding in Tokenized Language Models","created":"2025-05-20","cited_by_count":11,"area":null},{"id":"2506.07109","title":"Towards Universal Offline Black-Box Optimization via Learning Language Model Embeddings","created":"2025-06-08","cited_by_count":7,"area":null},{"id":"2509.23186","title":"Understanding and Enhancing the Planning Capability of Language Models via Multi-Token Prediction","created":"2025-09-27","cited_by_count":6,"area":null},{"id":"2601.19756","title":"Provable Learning of Random Hierarchy Models and Hierarchical Shallow-to-Deep Chaining","created":"2026-01-27","cited_by_count":6,"area":null},{"id":"2505.07070","title":"Scaling Laws and Representation Learning in Simple Hierarchical Languages: Transformers vs. Convolutional Architectures","created":"2025-05-11","cited_by_count":5,"area":null},{"id":"2511.01033","title":"On the Emergence of Induction Heads for In-Context Learning","created":"2025-11-02","cited_by_count":5,"area":null},{"id":"2602.06065","title":"Deep networks learn to parse uniform-depth context-free languages from local statistics","created":"2026-01-31","cited_by_count":5,"area":null},{"id":"2411.01663","title":"Unlocking the Theory Behind Scaling 1-Bit Neural Networks","created":"2024-11-03","cited_by_count":4,"area":null},{"id":"2510.02524","title":"Unraveling Syntax: Language Modeling and the Substructure of Grammars","created":"2025-10-02","cited_by_count":4,"area":null},{"id":"2601.01754","title":"Context-Free Recognition with Transformers","created":"2026-01-05","cited_by_count":4,"area":null},{"id":"2411.18885","title":"Sneaking Syntax into Transformer Language Models with Tree Regularization","created":"2024-11-28","cited_by_count":3,"area":null},{"id":"2504.17562","title":"When Does Metadata Conditioning (NOT) Work for Language Model Pre-Training? A Study with Context-Free Grammars","created":"2025-04-24","cited_by_count":3,"area":null},{"id":"2604.17121","title":"The Topological Trouble With Transformers","created":"2026-04-18","cited_by_count":3,"area":null},{"id":"2504.01450","title":"CASCADE Your Datasets for Cross-Mode Knowledge Retrieval of Language Models","created":"2025-04-02","cited_by_count":2,"area":null},{"id":"2507.02529","title":"RetrySQL: text-to-SQL training with retry data for self-correcting query generation","created":"2025-07-03","cited_by_count":2,"area":null},{"id":"2510.21258","title":"Correlation Dimension of Auto-Regressive Large Language Models","created":"2025-10-24","cited_by_count":2,"area":null},{"id":"2602.00533","title":"Convergent World Representations and Divergent Tasks","created":"2026-01-31","cited_by_count":2,"area":null},{"id":"2606.26749","title":"Structure Before Collapse: Transient semantic geometry in next-token prediction","created":"2026-06-25","cited_by_count":2,"area":null},{"id":"2503.04848","title":"Three tiers of computation in transformers and in brain architectures","created":"2025-03-05","cited_by_count":1,"area":null},{"id":"2505.04984","title":"Rethinking the Relationship between the Power Law and Hierarchical Structures","created":"2025-05-08","cited_by_count":1,"area":null},{"id":"2601.17869","title":"On the Emergence and Test-Time Use of Structural Information in Large Language Models","created":"2026-01-25","cited_by_count":1,"area":null},{"id":"2604.23267","title":"Fine-tuning vs. In-context Learning in Large Language Models: A Formal Language Learning Perspective","created":"2026-04-25","cited_by_count":1,"area":null},{"id":"2606.17522","title":"An expressivity analysis of hierarchical modelling in deep transformers via bounded-depth grammars","created":"2026-06-16","cited_by_count":1,"area":null},{"id":"2606.29858","title":"Smooth Scaling Laws Hide Stepwise Token Learning","created":"2026-06-29","cited_by_count":1,"area":null},{"id":"2502.04580","title":"Technical Debt in In-Context Learning: Diminishing Efficiency in Long Context","created":"2025-02-07","cited_by_count":0,"area":null},{"id":"2509.22553","title":"Linear Causal Representation Learning by Topological Ordering, Pruning, and Disentanglement","created":"2025-09-26","cited_by_count":0,"area":null},{"id":"2509.25073","title":"An empirical study on the limitation of Transformers in program trace generation","created":"2025-09-29","cited_by_count":0,"area":null},{"id":"2512.01870","title":"Testing Transformer Learnability on the Arithmetic Sequence of Rooted Trees","created":"2025-12-01","cited_by_count":0,"area":null},{"id":"2512.09394","title":"Language models as tools for investigating the distinction between possible and impossible natural languages","created":"2025-12-10","cited_by_count":0,"area":null},{"id":"2512.12447","title":"Large language models have learned to use language","created":"2025-12-13","cited_by_count":0,"area":null},{"id":"2512.13441","title":"Large language models are not about natural language","created":"2025-12-15","cited_by_count":0,"area":null},{"id":"2512.14506","title":"Linguists should learn to love speech-based deep learning models","created":"2025-12-16","cited_by_count":0,"area":null},{"id":"2601.10421","title":"Are Language Models Models?","created":"2026-01-15","cited_by_count":0,"area":null},{"id":"2604.09466","title":"Across the Levels of Analysis: Explaining Predictive Processing in Humans Requires More Than Machine-Estimated Probabilities","created":"2026-04-10","cited_by_count":0,"area":null},{"id":"2604.09501","title":"You Can't Fight in Here! This is BBS!","created":"2026-04-10","cited_by_count":0,"area":null},{"id":"2605.10061","title":"Not-So-Strange Love: Language Models and Generative Linguistic Theories are More Compatible than They Appear","created":"2026-05-11","cited_by_count":0,"area":null},{"id":"2605.26683","title":"An In-Vitro Study on Cross-Lingual Generalization in Language Models","created":"2026-05-26","cited_by_count":0,"area":null},{"id":"2606.08705","title":"Analyzing the Correlation Between Hallucinations and Knowledge Conflicts in Large Language Models","created":"2026-06-07","cited_by_count":0,"area":null},{"id":"2606.20347","title":"Critical Percolation as a Synthetic Data Model for Interpretability","created":"2026-06-18","cited_by_count":0,"area":null},{"id":"2608.05148","title":"Reasoning Core: Designing Broad Procedural Data for Completion-Supervised Reasoning Training","created":"2026-08-05","cited_by_count":0,"area":null},{"id":"2609.39827","title":"Synthetic Pre-pretraining Survives Scale, but Not as a Grammatical Prior","created":"2026-09-30","cited_by_count":0,"area":null}],"next_cursor":null}