{"list":"other","total":78,"rows":[{"id":"1706.03762","title":"Attention Is All You Need","created":"2017-06-12","cited_by_count":60361},{"id":"2006.11239","title":"Denoising Diffusion Probabilistic Models","created":"2020-06-19","cited_by_count":21076},{"id":"1503.03585","title":"Deep Unsupervised Learning using Nonequilibrium Thermodynamics","created":"2015-03-12","cited_by_count":7058},{"id":"1608.03983","title":"SGDR: Stochastic Gradient Descent with Warm Restarts","created":"2016-08-13","cited_by_count":5045},{"id":"1703.03400","title":"Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networks","created":"2017-03-09","cited_by_count":4897},{"id":"1709.01507","title":"Squeeze-and-Excitation Networks","created":"2017-09-05","cited_by_count":4789},{"id":"1406.1078","title":"Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translation","created":"2014-06-03","cited_by_count":4057},{"id":"1701.06538","title":"Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layer","created":"2017-01-23","cited_by_count":3509},{"id":"1905.10650","title":"Are Sixteen Heads Really Better than One?","created":"2019-05-25","cited_by_count":816},{"id":"1312.6211","title":"An Empirical Investigation of Catastrophic Forgetting in Gradient-Based Neural Networks","created":"2013-12-21","cited_by_count":722},{"id":"2003.05997","title":"Efficient Content-Based Sparse Attention with Routing Transformers","created":"2020-03-12","cited_by_count":471},{"id":"2102.04906","title":"Dynamic Neural Networks: A Survey","created":"2021-02-09","cited_by_count":408},{"id":"1806.04910","title":"Bilevel Programming for Hyperparameter Optimization and Meta-Learning","created":"2018-06-13","cited_by_count":405},{"id":"1502.03492","title":"Gradient-based Hyperparameter Optimization through Reversible Learning","created":"2015-02-11","cited_by_count":360},{"id":"1711.00489","title":"Don't Decay the Learning Rate, Increase the Batch Size","created":"2017-11-01","cited_by_count":320},{"id":"1904.03626","title":"On The Power of Curriculum Learning in Training Deep Networks","created":"2019-04-07","cited_by_count":286},{"id":"1909.00015","title":"Adaptively Sparse Transformers","created":"2019-08-30","cited_by_count":155},{"id":"1905.07799","title":"Adaptive Attention Span in Transformers","created":"2019-05-19","cited_by_count":149},{"id":"2002.09339","title":"Generalisation error in learning with random features and the hidden manifold model","created":"2020-02-21","cited_by_count":127},{"id":"2102.08127","title":"Learning curves of generic features maps for realistic datasets with a teacher-student model","created":"2021-02-16","cited_by_count":126},{"id":"1703.04782","title":"Online Learning Rate Adaptation with Hypergradient Descent","created":"2017-03-14","cited_by_count":118},{"id":"1708.03395","title":"Optimal Errors and Phase Transitions in High-Dimensional Generalized Linear Models","created":"2017-08-10","cited_by_count":116},{"id":"2006.14709","title":"The Gaussian equivalence of generative models for learning with shallow neural networks","created":"2020-06-25","cited_by_count":113},{"id":"1906.08632","title":"Dynamics of stochastic gradient descent for two-layer neural networks in the teacher-student setup","created":"2019-06-18","cited_by_count":112},{"id":"2012.03107","title":"When Do Curricula Work?","created":"2020-12-05","cited_by_count":106},{"id":"2205.09653","title":"Self-Consistent Dynamical Field Theory of Kernel Evolution in Wide Neural Networks","created":"2022-05-19","cited_by_count":105},{"id":"2012.09243","title":"Neural Pruning via Growing Regularization","created":"2020-12-16","cited_by_count":97},{"id":"2107.04384","title":"Continual Learning in the Teacher-Student Setup: Impact of Task Similarity","created":"2021-07-09","cited_by_count":88},{"id":"2205.09588","title":"How catastrophic can catastrophic forgetting be in linear regression?","created":"2022-05-19","cited_by_count":81},{"id":"2012.04030","title":"Statistical Mechanics of Deep Linear Neural Networks: The Back-Propagating Kernel Renormalization","created":"2020-12-07","cited_by_count":71},{"id":"2102.11742","title":"Classifying high-dimensional Gaussian mixtures: Where kernel methods fail and neural networks succeed","created":"2021-02-23","cited_by_count":69},{"id":"1412.1353","title":"Curriculum Learning of Multiple Tasks","created":"2014-12-03","cited_by_count":66},{"id":"2002.11544","title":"The role of regularization in classification of high-dimensional noisy Gaussian mixture","created":"2020-02-26","cited_by_count":63},{"id":"2006.06098","title":"Dynamical mean-field theory for stochastic gradient descent in Gaussian mixture classification","created":"2020-06-10","cited_by_count":60},{"id":"2402.03220","title":"The Benefits of Reusing Batches for Gradient Descent in Two-Layer Networks: Breaking the Curse of Information and Leap Exponents","created":"2024-02-05","cited_by_count":52},{"id":"1703.06229","title":"Curriculum Dropout","created":"2017-03-18","cited_by_count":50},{"id":"2406.09405","title":"Why Warmup the Learning Rate? Underlying Mechanisms and Improvements","created":"2024-06-13","cited_by_count":46},{"id":"2302.00375","title":"Bayes-optimal Learning of Deep Random Networks of Extensive-width","created":"2023-02-01","cited_by_count":41},{"id":"2310.03575","title":"Analysis of learning a flow-based generative model from limited sample complexity","created":"2023-10-05","cited_by_count":38},{"id":"2207.10430","title":"The Neural Race Reduction: Dynamics of Abstraction in Gated Networks","created":"2022-07-21","cited_by_count":37},{"id":"2306.03534","title":"Continual Learning in Linear Classification on Separable Data","created":"2023-06-06","cited_by_count":34},{"id":"1812.03472","title":"Theory of Curriculum Learning, with Convex Loss Functions","created":"2018-12-09","cited_by_count":33},{"id":"1612.05086","title":"Coupling Adaptive Batch Sizes with Learning Rates","created":"2016-12-15","cited_by_count":30},{"id":"2402.03902","title":"A phase transition between positional and semantic learning in a solvable model of dot-product attention","created":"2024-02-06","cited_by_count":30},{"id":"1712.02029","title":"AdaBatch: Adaptive Batch Sizes for Training Deep Neural Networks","created":"2017-12-06","cited_by_count":29},{"id":"2106.08068","title":"An Analytical Theory of Curriculum Learning in Teacher-Student Networks","created":"2021-06-15","cited_by_count":27},{"id":"2201.02115","title":"The dynamics of representation learning in shallow, non-linear autoencoders","created":"2022-01-06","cited_by_count":27},{"id":"1910.01526","title":"Gated Linear Networks","created":"2019-09-30","cited_by_count":26},{"id":"2502.21269","title":"Dynamical Decoupling of Generalization and Overfitting in Large Two-Layer Networks","created":"2025-02-28","cited_by_count":25},{"id":"2306.16921","title":"Provable Advantage of Curriculum Learning on Parity Targets with Mixed Inputs","created":"2023-06-29","cited_by_count":22},{"id":"2210.02157","title":"The Influence of Learning Rule on Representation Dynamics in Wide Neural Networks","created":"2022-10-05","cited_by_count":19},{"id":"2301.13833","title":"A Mathematical Model for Curriculum Learning for Parities","created":"2023-01-31","cited_by_count":19},{"id":"2305.11041","title":"High-dimensional Asymptotics of Denoising Autoencoders","created":"2023-05-18","cited_by_count":19},{"id":"1806.05413","title":"Learning Dynamics of Linear Denoising Autoencoders","created":"2018-06-14","cited_by_count":16},{"id":"2205.09029","title":"Maslow's Hammer for Catastrophic Forgetting: Node Re-Use vs Node Activation","created":"2022-05-18","cited_by_count":16},{"id":"2402.18361","title":"Why Do Animals Need Shaping? A Theory of Task Composition and Curriculum Learning","created":"2024-02-28","cited_by_count":16},{"id":"2407.10315","title":"Order parameters and phase transitions of continual learning in deep neural networks","created":"2024-07-14","cited_by_count":14},{"id":"2409.18061","title":"Optimal Protocols for Continual Learning via Statistical Physics and Control Theory","created":"2024-09-26","cited_by_count":14},{"id":"2501.03937","title":"A solvable model of learning generative diffusion: theory and insights","created":"2025-01-07","cited_by_count":14},{"id":"2302.05440","title":"Forward Learning with Top-Down Feedback: Empirical and Analytical Characterization","created":"2023-02-10","cited_by_count":13},{"id":"2402.13999","title":"Asymptotics of Learning with Deep Structured (Random) Features","created":"2024-02-21","cited_by_count":13},{"id":"2210.17449","title":"Globally Gated Deep Linear Networks","created":"2022-10-31","cited_by_count":12},{"id":"2409.13904","title":"High-dimensional learning of narrow neural networks","created":"2024-09-20","cited_by_count":12},{"id":"1406.3269","title":"Scheduled denoising autoencoders","created":"2014-06-12","cited_by_count":11},{"id":"2304.02912","title":"Classification of Heavy-tailed Features in High Dimensions: a Superstatistical Approach","created":"2023-04-06","cited_by_count":11},{"id":"2205.15935","title":"Bias-inducing geometries: an exactly solvable data model with fairness implications","created":"2022-05-31","cited_by_count":9},{"id":"2211.14961","title":"Linear Classification of Neural Manifolds with Correlated Variability","created":"2022-11-27","cited_by_count":9},{"id":"2406.01589","title":"Tilting the Odds at the Lottery: the Interplay of Overparameterisation and Curricula in Neural Networks","created":"2024-06-03","cited_by_count":9},{"id":"2506.02651","title":"Asymptotics of SGD in Sequence-Single Index Models and Single-Layer Attention Networks","created":"2025-06-03","cited_by_count":9},{"id":"2405.18296","title":"Bias in Motion: Theoretical Insights into the Dynamics of Bias in SGD Training","created":"2024-05-28","cited_by_count":8},{"id":"2501.00988","title":"Optimizing Noise Schedules of Generative Models in High Dimensionss","created":"2025-01-02","cited_by_count":7},{"id":"2405.09535","title":"Restoring balance: principled under/oversampling of data for optimal classification","created":"2024-05-15","cited_by_count":6},{"id":"2306.10404","title":"The RL Perceptron: Generalisation Dynamics of Policy Learning in High Dimensions","created":"2023-06-17","cited_by_count":5},{"id":"2202.04509","title":"Optimal learning rate schedules in high-dimensional non-convex optimization problems","created":"2022-02-09","cited_by_count":4},{"id":"2310.19919","title":"Meta-Learning Strategies through Value Maximization in Neural Networks","created":"2023-10-30","cited_by_count":4},{"id":"2202.02649","title":"The Implicit Bias of Gradient Descent on Generalized Gated Linear Networks","created":"2022-02-05","cited_by_count":3},{"id":"2405.06851","title":"Nonlinear classification of neural manifolds with contextual information","created":"2024-05-10","cited_by_count":2},{"id":"2505.07792","title":"Analytic theory of dropout regularization","created":"2025-05-12","cited_by_count":2}],"next_cursor":null}