{"list":"other","total":61,"rows":[{"id":"1706.03762","title":"Attention Is All You Need","created":"2017-06-12","cited_by_count":60361},{"id":"2005.14165","title":"Language Models are Few-Shot Learners","created":"2020-05-28","cited_by_count":32419},{"id":"2303.08774","title":"GPT-4 Technical Report","created":"2023-03-15","cited_by_count":18396},{"id":"2201.11903","title":"Chain-of-Thought Prompting Elicits Reasoning in Large Language Models","created":"2022-01-28","cited_by_count":12459},{"id":"1806.07572","title":"Neural Tangent Kernel: Convergence and Generalization in Neural Networks","created":"2018-06-20","cited_by_count":2621},{"id":"2303.12712","title":"Sparks of Artificial General Intelligence: Early experiments with GPT-4","created":"2023-03-22","cited_by_count":2592},{"id":"2206.07682","title":"Emergent Abilities of Large Language Models","created":"2022-06-15","cited_by_count":2512},{"id":"2206.04615","title":"Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language models","created":"2022-06-09","cited_by_count":1998},{"id":"2210.03350","title":"Measuring and Narrowing the Compositionality Gap in Language Models","created":"2022-10-07","cited_by_count":1075},{"id":"1706.05394","title":"A Closer Look at Memorization in Deep Networks","created":"2017-06-16","cited_by_count":942},{"id":"2201.02177","title":"Grokking: Generalization Beyond Overfitting on Small Algorithmic Datasets","created":"2022-01-06","cited_by_count":629},{"id":"2206.01714","title":"Compositional Visual Generation with Composable Diffusion Models","created":"2022-06-03","cited_by_count":624},{"id":"1904.11955","title":"On Exact Computation with an Infinitely Wide Neural Net","created":"2019-04-26","cited_by_count":573},{"id":"2305.18654","title":"Faith and Fate: Limits of Transformers on Compositionality","created":"2023-05-29","cited_by_count":503},{"id":"1804.06561","title":"A Mean Field View of the Landscape of Two-Layers Neural Networks","created":"2018-04-18","cited_by_count":466},{"id":"1805.09545","title":"On the Global Convergence of Gradient Descent for Over-parameterized Models using Optimal Transport","created":"2018-05-24","cited_by_count":426},{"id":"1501.01571","title":"An Introduction to Matrix Concentration Inequalities","created":"2015-01-07","cited_by_count":397},{"id":"2212.05032","title":"Training-Free Structured Diffusion Guidance for Compositional Text-to-Image Synthesis","created":"2022-12-09","cited_by_count":388},{"id":"1901.06523","title":"Frequency Principle: Fourier Analysis Sheds Light on Deep Neural Networks","created":"2019-01-19","cited_by_count":368},{"id":"2210.01240","title":"Language Models Are Greedy Reasoners: A Systematic Formal Analysis of Chain-of-Thought","created":"2022-10-03","cited_by_count":337},{"id":"2205.09712","title":"Selection-Inference: Exploiting Large Language Models for Interpretable Logical Reasoning","created":"2022-05-19","cited_by_count":334},{"id":"2210.10749","title":"Transformers Learn Shortcuts to Automata","created":"2022-10-19","cited_by_count":268},{"id":"1908.08351","title":"Compositionality decomposed: how do neural networks generalise?","created":"2019-08-22","cited_by_count":265},{"id":"2010.05465","title":"COGS: A Compositional Generalization Challenge Based on Semantic Interpretation","created":"2020-10-12","cited_by_count":263},{"id":"2305.14160","title":"Label Words are Anchors: An Information Flow Perspective for Understanding In-Context Learning","created":"2023-05-23","cited_by_count":236},{"id":"2302.11552","title":"Reduce, Reuse, Recycle: Compositional Generation with Energy-Based Diffusion Models and MCMC","created":"2023-02-22","cited_by_count":220},{"id":"2004.08249","title":"Understanding the Difficulty of Training Transformers","created":"2020-04-17","cited_by_count":210},{"id":"2203.00555","title":"DeepNet: Scaling Transformers to 1,000 Layers","created":"2022-03-01","cited_by_count":178},{"id":"2210.01117","title":"Omnigrok: Grokking Beyond Algorithmic Data","created":"2022-10-03","cited_by_count":146},{"id":"2208.14271","title":"Faithful Reasoning Using Large Language Models","created":"2022-08-30","cited_by_count":130},{"id":"1808.09372","title":"Mean Field Analysis of Neural Networks: A Central Limit Theorem","created":"2018-08-28","cited_by_count":107},{"id":"2212.10015","title":"Benchmarking Spatial Relationships in Text-to-Image Generation","created":"2022-12-20","cited_by_count":97},{"id":"2310.09336","title":"Compositional Abilities Emerge Multiplicatively: Exploring Diffusion Models on a Synthetic Task","created":"2023-10-13","cited_by_count":93},{"id":"2204.13807","title":"A very preliminary analysis of DALL-E 2","created":"2022-04-25","cited_by_count":82},{"id":"2007.07497","title":"Phase diagram for two-layer ReLU neural networks at infinite-width limit","created":"2020-07-15","cited_by_count":67},{"id":"2110.07732","title":"The Neural Data Router: Adaptive Control Flow in Transformers Improves Systematic Generalization","created":"2021-10-14","cited_by_count":62},{"id":"1908.11365","title":"Improving Deep Transformer with Depth-Scaled Initialization and Merged Attention","created":"2019-08-29","cited_by_count":59},{"id":"2208.00005","title":"Testing Relational Understanding in Text-Guided Image Generation","created":"2022-07-29","cited_by_count":59},{"id":"2305.09828","title":"Mimetic Initialization of Self-Attention Layers","created":"2023-05-16","cited_by_count":54},{"id":"1904.04326","title":"A Comparative Analysis of the Optimization and Generalization Property of Two-layer Neural Network and Random Feature Models Under Gradient Descent Dynamics","created":"2019-04-08","cited_by_count":49},{"id":"1906.07842","title":"Gradient Dynamics of Shallow Univariate ReLU Networks","created":"2019-06-18","cited_by_count":46},{"id":"2102.08098","title":"GradInit: Learning to Initialize Neural Networks for Stable and Efficient Training","created":"2021-02-16","cited_by_count":44},{"id":"2205.01128","title":"Neurocompositional computing: From the Central Paradox of Cognition to a new generation of AI systems","created":"2022-05-02","cited_by_count":44},{"id":"2301.10884","title":"Break It Down: Evidence for Structural Compositionality in Neural Networks","created":"2023-01-26","cited_by_count":44},{"id":"2010.03763","title":"Assessing Phrasal Representation and Composition in Transformers","created":"2020-10-08","cited_by_count":41},{"id":"2105.14573","title":"Embedding Principle of Loss Landscape of Deep Neural Networks","created":"2021-05-30","cited_by_count":38},{"id":"1905.07777","title":"A type of generalization error induced by initialization in deep neural networks","created":"2019-05-19","cited_by_count":33},{"id":"2105.11686","title":"Towards Understanding the Condensation of Neural Networks at Initial Training","created":"2021-05-25","cited_by_count":32},{"id":"2203.17271","title":"Do Vision-Language Pretrained Models Learn Composable Primitive Concepts?","created":"2022-03-31","cited_by_count":31},{"id":"2210.12889","title":"DALL-E 2 Fails to Reliably Capture Common Syntactic Processes","created":"2022-10-23","cited_by_count":31},{"id":"2402.17709","title":"Case-Based or Rule-Based: How Do Transformers Do the Math?","created":"2024-02-27","cited_by_count":26},{"id":"2207.05952","title":"Implicit regularization of dropout","created":"2022-07-13","cited_by_count":25},{"id":"2402.00522","title":"Understanding the Expressive Power and Mechanisms of Transformer for Sequence Modeling","created":"2024-02-01","cited_by_count":25},{"id":"2111.15527","title":"Embedding Principle: a hierarchical structure of loss landscape of deep neural networks","created":"2021-11-30","cited_by_count":22},{"id":"2205.12101","title":"Empirical Phase Diagram for Three-layer Neural Networks with Infinite Width","created":"2022-05-24","cited_by_count":17},{"id":"2305.12133","title":"Loss Spike in Training Neural Networks","created":"2023-05-20","cited_by_count":16},{"id":"2210.06350","title":"CTL++: Evaluating Generalization on Never-Seen Compositional Patterns of Known Functions, and Compatibility of Neural Representations","created":"2022-10-12","cited_by_count":12},{"id":"1805.09657","title":"Learning compositionally through attentive guidance","created":"2018-05-20","cited_by_count":11},{"id":"2305.15850","title":"Stochastic Modified Equations and Dynamics of Dropout Algorithm","created":"2023-05-25","cited_by_count":11},{"id":"2401.08309","title":"Anchor function: a type of benchmark functions for studying language models","created":"2024-01-16","cited_by_count":11},{"id":"2211.11623","title":"Linear Stability Hypothesis and Rank Stratification for Nonlinear Models","created":"2022-11-21","cited_by_count":7}],"next_cursor":null}