{"list":"other","total":62,"rows":[{"id":"1301.3781","title":"Efficient Estimation of Word Representations in Vector Space","created":"2013-01-16","cited_by_count":4375},{"id":"1310.4546","title":"Distributed Representations of Words and Phrases and their Compositionality","created":"2013-10-16","cited_by_count":3474},{"id":"2309.08600","title":"Sparse Autoencoders Find Highly Interpretable Features in Language Models","created":"2023-09-15","cited_by_count":1420},{"id":"1905.05950","title":"BERT Rediscovers the Classical NLP Pipeline","created":"2019-05-15","cited_by_count":1059},{"id":"2209.10652","title":"Toy Models of Superposition","created":"2022-09-21","cited_by_count":971},{"id":"2008.08186","title":"Prevalence of Neural Collapse during the terminal phase of deep learning training","created":"2020-08-18","cited_by_count":719},{"id":"2311.03658","title":"The Linear Representation Hypothesis and the Geometry of Large Language Models","created":"2023-11-07","cited_by_count":716},{"id":"2310.06824","title":"The Geometry of Truth: Emergent Linear Structure in Large Language Model Representations of True/False Datasets","created":"2023-10-10","cited_by_count":712},{"id":"1710.10345","title":"The Implicit Bias of Gradient Descent on Separable Data","created":"2017-10-27","cited_by_count":655},{"id":"2210.13382","title":"Emergent World Representations: Exploring a Sequence Model Trained on a Synthetic Task","created":"2022-10-24","cited_by_count":431},{"id":"2309.00941","title":"Emergent Linear Representations in World Models of Self-Supervised Sequence Models","created":"2023-09-02","cited_by_count":319},{"id":"2310.02207","title":"Language Models Represent Space and Time","created":"2023-10-03","cited_by_count":316},{"id":"1908.08351","title":"Compositionality decomposed: how do neural networks generalise?","created":"2019-08-22","cited_by_count":265},{"id":"2105.02375","title":"A Geometric Analysis of Neural Collapse with Unconstrained Features","created":"2021-05-06","cited_by_count":227},{"id":"1906.02715","title":"Visualizing and Measuring the Geometry of BERT","created":"2019-06-06","cited_by_count":216},{"id":"2106.00737","title":"Implicit Representations of Meaning in Neural Language Models","created":"2021-06-01","cited_by_count":180},{"id":"2101.12699","title":"Exploring Deep Neural Networks via Layer-Peeled Model: Minority Collapse in Imbalanced Training","created":"2021-01-29","cited_by_count":166},{"id":"2406.01506","title":"The Geometry of Categorical and Hierarchical Concepts in Large Language Models","created":"2024-06-03","cited_by_count":159},{"id":"2011.11619","title":"Neural collapse with unconstrained features","created":"2020-11-23","cited_by_count":142},{"id":"2309.07311","title":"Sudden Drops in the Loss: Syntax Acquisition, Phase Transitions, and Simplicity Bias in MLMs","created":"2023-09-13","cited_by_count":124},{"id":"2305.13673","title":"Physics of Language Models: Part 1, Learning Hierarchical Language Structures","created":"2023-05-23","cited_by_count":83},{"id":"2208.05512","title":"Imbalance Trouble: Revisiting Neural-Collapse Geometry","created":"2022-08-10","cited_by_count":80},{"id":"2403.03867","title":"On the Origins of Linear Representations in Large Language Models","created":"2024-03-06","cited_by_count":79},{"id":"2405.15943","title":"Transformers represent belief state geometry in their residual stream","created":"2024-05-24","cited_by_count":77},{"id":"2001.03632","title":"Does syntax need to grow on trees? Sources of hierarchical inductive bias in sequence-to-sequence networks","created":"2020-01-10","cited_by_count":72},{"id":"2411.04986","title":"The Semantic Hub Hypothesis: Language Models Share Semantic Representations Across Languages and Modalities","created":"2024-11-07","cited_by_count":69},{"id":"2403.19827","title":"Language Models Learn Rare Phenomena from Less Rare Phenomena: The Case of the Missing AANNs","created":"2024-03-28","cited_by_count":65},{"id":"1803.01814","title":"Norm matters: efficient and accurate normalization schemes in deep networks","created":"2018-03-05","cited_by_count":62},{"id":"2410.04265","title":"AI as Humanity's Salieri: Quantifying Linguistic Creativity of Language Models via Systematic Attribution of Machine Text against Web Text","created":"2024-10-05","cited_by_count":42},{"id":"2211.01288","title":"Characterizing Intrinsic Compositionality in Transformers with Tree Projections","created":"2022-11-02","cited_by_count":41},{"id":"2505.00661","title":"On the generalization of language models from in-context learning and finetuning: a controlled study","created":"2025-05-01","cited_by_count":40},{"id":"2310.05351","title":"Generalized Neural Collapse for a Large Number of Classes","created":"2023-10-09","cited_by_count":39},{"id":"2406.00048","title":"Towards a theory of how the structure of language is acquired by deep neural networks","created":"2024-05-28","cited_by_count":39},{"id":"2405.17767","title":"Linguistic Collapse: Neural Collapse in (Large) Language Models","created":"2024-05-28","cited_by_count":38},{"id":"2502.19249","title":"Between Circuits and Chomsky: Pre-pretraining on Formal Languages Imparts Linguistic Biases","created":"2025-02-26","cited_by_count":37},{"id":"2503.21676","title":"How do language models learn facts? Dynamics, curricula and hallucinations","created":"2025-03-27","cited_by_count":37},{"id":"2304.13060","title":"Injecting structural hints: Using language models to study inductive biases in language learning","created":"2023-04-25","cited_by_count":35},{"id":"2405.15750","title":"Filtered Corpus Training (FiCT) Shows that Language Models can Generalize from Indirect Evidence","created":"2024-05-24","cited_by_count":35},{"id":"2509.23024","title":"Tracing the Representation Geometry of Language Models from Pretraining to Post-training","created":"2025-09-27","cited_by_count":35},{"id":"2401.06416","title":"Mission: Impossible Language Models","created":"2024-01-12","cited_by_count":32},{"id":"2404.16367","title":"Learning Syntax Without Planting Trees: Understanding Hierarchical Generalization in Transformers","created":"2024-04-25","cited_by_count":24},{"id":"2408.15417","title":"Implicit Geometry of Next-token Prediction: From Language Sparsity Patterns to Model Representations","created":"2024-08-27","cited_by_count":24},{"id":"2602.15029","title":"Symmetry in language statistics shapes the geometry of model representations","created":"2026-02-16","cited_by_count":24},{"id":"2303.07608","title":"On the Implicit Geometry of Cross-Entropy Parameterizations for Label-Imbalanced Data","created":"2023-03-14","cited_by_count":23},{"id":"2109.12036","title":"Transformers Generalize Linearly","created":"2021-09-24","cited_by_count":19},{"id":"2410.04887","title":"Wide Neural Networks Trained with Weight Decay Provably Exhibit Neural Collapse","created":"2024-10-07","cited_by_count":16},{"id":"2505.18091","title":"Data Mixing Can Induce Phase Transitions in Knowledge Acquisition","created":"2025-05-23","cited_by_count":16},{"id":"2603.10055","title":"Training Language Models via Neural Cellular Automata","created":"2026-03-09","cited_by_count":15},{"id":"2402.18551","title":"Implicit Optimization Bias of Next-Token Prediction in Linear Models","created":"2024-02-28","cited_by_count":14},{"id":"2410.23169","title":"The Persistence of Neural Collapse Despite Low-Rank Bias","created":"2024-10-30","cited_by_count":13},{"id":"2305.05448","title":"Robust Implicit Regularization via Weight Normalization","created":"2023-05-09","cited_by_count":12},{"id":"2306.17105","title":"Are Neurons Actually Collapsed? On the Fine-Grained Structure in Neural Representations","created":"2023-06-29","cited_by_count":10},{"id":"2412.04619","title":"Sometimes I am a Tree: Data Drives Unstable Hierarchical Generalization","created":"2024-12-05","cited_by_count":10},{"id":"2505.15239","title":"Neural Collapse is Globally Optimal in Deep Regularized ResNets and Transformers","created":"2025-05-21","cited_by_count":10},{"id":"2510.26745","title":"Deep sequence models tend to memorize geometrically; it is unclear why","created":"2025-10-30","cited_by_count":9},{"id":"2306.11680","title":"The Implicit Bias of Batch Normalization in Linear Models and Two-layer Linear Convolutional Neural Networks","created":"2023-06-20","cited_by_count":8},{"id":"2410.11474","title":"How Transformers Get Rich: Approximation and Dynamics Analysis","created":"2024-10-15","cited_by_count":8},{"id":"2502.09863","title":"Closed-Form Training Dynamics Reveal Learned Features and Linear Structure in Word2Vec-like Models","created":"2025-02-14","cited_by_count":8},{"id":"2510.16096","title":"Facts in Stats: Impacts of Pretraining Diversity on Language Model Generalization","created":"2025-10-17","cited_by_count":3},{"id":"2601.22510","title":"Shattered Compositionality: Counterintuitive Learning Dynamics of Transformers for Arithmetic","created":"2026-01-30","cited_by_count":3},{"id":"2603.20969","title":"Understanding Contextual Recall in Transformers: How Finetuning Enables In-Context Reasoning over Pretraining Knowledge","created":"2026-03-21","cited_by_count":3},{"id":"2509.20124","title":"Probability Signature: Bridging Data Semantics and Embedding Structure in Language Models","created":"2025-09-24","cited_by_count":2}],"next_cursor":null}