{"total":56,"rows":[{"id":"2305.16380","title":"Scan and Snap: Understanding Training Dynamics and Token Composition in 1-layer Transformer","created":"2023-05-25","cited_by_count":102,"area":null},{"id":"2301.11300","title":"ZiCo: Zero-shot NAS via Inverse Coefficient of Variation on Gradients","created":"2023-01-26","cited_by_count":58,"area":null},{"id":"2310.00535","title":"JoMA: Demystifying Multilayer Transformers via JOint Dynamics of MLP and Attention","created":"2023-10-01","cited_by_count":52,"area":null},{"id":"2102.02410","title":"A Local Convergence Theory for Mildly Over-Parameterized Two-Layer Neural Network","created":"2021-02-04","cited_by_count":47,"area":null},{"id":"2209.09893","title":"Deep Generalized Schr\\\"odinger Bridge","created":"2022-09-20","cited_by_count":47,"area":null},{"id":"2205.14612","title":"Do Residual Neural Networks discretize Neural Ordinary Differential Equations?","created":"2022-05-29","cited_by_count":27,"area":null},{"id":"2111.01875","title":"Subquadratic Overparameterization for Shallow Neural Networks","created":"2021-11-02","cited_by_count":26,"area":null},{"id":"2302.10034","title":"Over-Parameterization Exponentially Slows Down Gradient Descent for Learning a Single Neuron","created":"2023-02-20","cited_by_count":25,"area":null},{"id":"2105.14417","title":"Overparameterization of deep ResNet: zero loss and mean-field analysis","created":"2021-05-30","cited_by_count":24,"area":null},{"id":"2308.13431","title":"Six Lectures on Linearized Neural Networks","created":"2023-08-25","cited_by_count":20,"area":null},{"id":"2107.00961","title":"ResIST: Layer-Wise Decomposition of ResNets for Distributed Training","created":"2021-07-02","cited_by_count":18,"area":null},{"id":"2310.01769","title":"How Over-Parameterization Slows Down Gradient Descent in Matrix Sensing: The Curses of Symmetry and Initialization","created":"2023-10-03","cited_by_count":18,"area":null},{"id":"2509.10167","title":"The Hidden Width of Deep ResNets: Tight Error Bounds and Phase Diagram","created":"2025-09-12","cited_by_count":17,"area":null},{"id":"2105.05228","title":"Global Convergence of Three-layer Neural Networks in the Mean Field Regime","created":"2021-05-11","cited_by_count":16,"area":null},{"id":"2105.12245","title":"Scaling Properties of Deep Residual Networks","created":"2021-05-25","cited_by_count":16,"area":null},{"id":"2411.10830","title":"One-Layer Transformer Provably Learns One-Nearest Neighbor In Context","created":"2024-11-16","cited_by_count":16,"area":null},{"id":"2102.08373","title":"Analysis of feature learning in weight-tied autoencoders via the mean field lens","created":"2021-02-16","cited_by_count":14,"area":null},{"id":"2110.05667","title":"Why Lottery Ticket Wins? A Theoretical Perspective of Sample Complexity on Pruned Neural Networks","created":"2021-10-12","cited_by_count":14,"area":null},{"id":"2204.10782","title":"On Feature Learning in Neural Networks with Global Convergence Guarantees","created":"2022-04-22","cited_by_count":13,"area":null},{"id":"2212.08791","title":"Two-Scale Gradient Descent Ascent Dynamics Finds Mixed Nash Equilibria of Continuous Games: A Mean-Field Perspective","created":"2022-12-17","cited_by_count":13,"area":null},{"id":"2106.06682","title":"Solving PDEs on Unknown Manifolds with Machine Learning","created":"2021-06-12","cited_by_count":12,"area":null},{"id":"2110.02926","title":"On the Global Convergence of Gradient Descent for multi-layer ResNets in the mean-field regime","created":"2021-10-06","cited_by_count":12,"area":null},{"id":"2112.02668","title":"On the Convergence of Shallow Neural Network Training with Randomly Masked Neurons","created":"2021-12-05","cited_by_count":11,"area":null},{"id":"2109.03992","title":"Stationary Density Estimation of It\\^o Diffusions Using Deep Learning","created":"2021-09-09","cited_by_count":9,"area":null},{"id":"2202.10947","title":"Provably convergent quasistatic dynamics for mean-field two-player zero-sum games","created":"2022-02-15","cited_by_count":9,"area":null},{"id":"2304.01063","title":"Depth Separation with Multilayer Mean-Field Networks","created":"2023-04-03","cited_by_count":9,"area":null},{"id":"2602.05970","title":"Inverse Depth Scaling From Most Layers Being Similar","created":"2026-02-05","cited_by_count":9,"area":null},{"id":"2403.12887","title":"Understanding the training of infinitely deep and wide ResNets with Conditional Optimal Transport","created":"2024-03-19","cited_by_count":8,"area":null},{"id":"2112.13530","title":"Wasserstein Flow Meets Replicator Dynamics: A Mean-Field Analysis of Representation Learning in Actor-Critic","created":"2021-12-27","cited_by_count":7,"area":null},{"id":"2210.05371","title":"On skip connections and normalisation layers in deep optimisation","created":"2022-10-10","cited_by_count":7,"area":null},{"id":"2110.15954","title":"Limiting fluctuation and trajectorial stability of multilayer neural networks with mean field training","created":"2021-10-29","cited_by_count":5,"area":null},{"id":"2307.01177","title":"Neural Hilbert Ladders: Multi-Layer Neural Networks in Function Space","created":"2023-07-03","cited_by_count":5,"area":null},{"id":"2311.15365","title":"A convergence result of a continuous model of deep learning via a \\L{}ojasiewicz--Simon inequality","created":"2023-11-26","cited_by_count":5,"area":null},{"id":"2401.16655","title":"Rademacher Complexity of Neural ODEs via Chen-Fliess Series","created":"2024-01-30","cited_by_count":5,"area":null},{"id":"2108.00259","title":"How much pre-training is enough to discover a good subnetwork?","created":"2021-07-31","cited_by_count":4,"area":null},{"id":"2205.05662","title":"Deep Architecture Connectivity Matters for Its Convergence: A Fine-Grained Analysis","created":"2022-05-11","cited_by_count":4,"area":null},{"id":"2309.15244","title":"Homotopy Relaxation Training Algorithms for Infinite-Width Two-Layer ReLU Neural Networks","created":"2023-09-26","cited_by_count":4,"area":null},{"id":"2204.07261","title":"Convergence and Implicit Regularization Properties of Gradient Descent for Deep Residual Networks","created":"2022-04-14","cited_by_count":3,"area":null},{"id":"2210.06819","title":"Mean-field analysis for heavy ball methods: Dropout-stability, connectivity, and global convergence","created":"2022-10-13","cited_by_count":3,"area":null},{"id":"2210.16286","title":"A Functional-Space Mean-Field Theory of Partially-Trained Three-Layer Neural Networks","created":"2022-10-28","cited_by_count":3,"area":null},{"id":"2212.08199","title":"Asymptotic Analysis of Deep Residual Networks","created":"2022-12-15","cited_by_count":3,"area":null},{"id":"2303.05924","title":"Variational formulations of ODE-Net as a mean-field optimal control problem and existence results","created":"2023-03-09","cited_by_count":3,"area":null},{"id":"2306.02192","title":"Correcting Auto-Differentiation in Neural-ODE Training","created":"2023-06-03","cited_by_count":3,"area":null},{"id":"2403.09889","title":"Generalization of Scaled Deep ResNets in the Mean-Field Regime","created":"2024-03-14","cited_by_count":3,"area":null},{"id":"2105.03788","title":"Dynamic Game Theoretic Neural Optimizer","created":"2021-05-08","cited_by_count":2,"area":null},{"id":"2505.07642","title":"Convergence of Time-Averaged Mean Field Gradient Descent Dynamics for Continuous Multi-Player Zero-Sum Games","created":"2025-05-12","cited_by_count":2,"area":null},{"id":"2205.06571","title":"Convergence Analysis of Deep Residual Networks","created":"2022-05-13","cited_by_count":1,"area":null},{"id":"2303.06726","title":"Global Optimality of Elman-type RNN in the Mean-Field Regime","created":"2023-03-12","cited_by_count":1,"area":null},{"id":"2404.12312","title":"A Mean-Field Analysis of Neural Stochastic Gradient Descent-Ascent for Functional Minimax Optimization","created":"2024-04-18","cited_by_count":1,"area":null},{"id":"2502.03359","title":"GHOST: Gaussian Hypothesis Open-Set Technique","created":"2025-02-05","cited_by_count":1,"area":null},{"id":"2502.05360","title":"Curse of Dimensionality in Neural Network Optimization","created":"2025-02-07","cited_by_count":1,"area":null},{"id":"2510.03470","title":"On residual network depth","created":"2025-10-03","cited_by_count":1,"area":null},{"id":"2605.17660","title":"Training Infinitely Deep and Wide Transformers","created":"2026-05-17","cited_by_count":1,"area":null},{"id":"2408.08681","title":"A Mean Field Ansatz for Zero-Shot Weight Transfer","created":"2024-08-16","cited_by_count":0,"area":null},{"id":"2501.14660","title":"Mean-field limit from general mixtures of experts to quantum neural networks","created":"2025-01-24","cited_by_count":0,"area":"moe"},{"id":"2607.16761","title":"Dropout and Random Gradient Masking Are Asymptotically Equivalent in Large ResNets","created":"2026-07-18","cited_by_count":0,"area":null}],"next_cursor":null}