{"total":30,"rows":[{"id":"2303.14186","title":"TRAK: Attributing Model Behavior at Scale","created":"2023-03-24","cited_by_count":283,"area":null},{"id":"2103.12828","title":"Learning to Optimize: A Primer and A Benchmark","created":"2021-03-23","cited_by_count":208,"area":null},{"id":"2205.01445","title":"High-dimensional Asymptotics of Feature Learning: How One Gradient Step Improves the Representation","created":"2022-05-03","cited_by_count":150,"area":null},{"id":"2110.01654","title":"Improved architectures and training algorithms for deep operator networks","created":"2021-10-04","cited_by_count":86,"area":null},{"id":"2103.03936","title":"Pufferfish: Communication-efficient Models At No Extra Cost","created":"2021-03-05","cited_by_count":61,"area":null},{"id":"2409.03137","title":"The AdEMAMix Optimizer: Better, Faster, Older","created":"2024-09-05","cited_by_count":54,"area":null},{"id":"2105.02716","title":"Noether's Learning Dynamics: Role of Symmetry Breaking in Neural Networks","created":"2021-05-06","cited_by_count":50,"area":null},{"id":"2207.05931","title":"Towards understanding how momentum improves generalization in deep learning","created":"2022-07-13","cited_by_count":40,"area":null},{"id":"2211.06506","title":"Spectral Evolution and Invariance in Linear-width Neural Networks","created":"2022-11-11","cited_by_count":30,"area":null},{"id":"2206.12755","title":"Training Your Sparse Neural Network Better with Any Mask","created":"2022-06-26","cited_by_count":26,"area":null},{"id":"2106.00958","title":"A Generalizable Approach to Learning Optimizers","created":"2021-06-02","cited_by_count":23,"area":null},{"id":"2302.12250","title":"Phase diagram of early training dynamics in deep neural networks: effect of the learning rate, depth, and width","created":"2023-02-23","cited_by_count":19,"area":null},{"id":"2306.09000","title":"When and Why Momentum Accelerates SGD:An Empirical Study","created":"2023-06-15","cited_by_count":19,"area":null},{"id":"2305.18512","title":"A Rainbow in Deep Network Black Boxes","created":"2023-05-29","cited_by_count":18,"area":null},{"id":"2111.00843","title":"How I Learned to Stop Worrying and Love Retraining","created":"2021-11-01","cited_by_count":12,"area":null},{"id":"2102.10734","title":"Provable Super-Convergence with a Large Cyclical Learning Rate","created":"2021-02-22","cited_by_count":10,"area":null},{"id":"2212.01076","title":"Are Straight-Through gradients and Soft-Thresholding all you need for Sparse Training?","created":"2022-12-02","cited_by_count":9,"area":null},{"id":"2403.05293","title":"Leveraging Continuous Time to Understand Momentum When Training Diagonal Linear Networks","created":"2024-03-08","cited_by_count":9,"area":null},{"id":"2302.07851","title":"Continuized Acceleration for Quasar Convex Functions in Non-Convex Optimization","created":"2023-02-15","cited_by_count":6,"area":null},{"id":"2201.04545","title":"On generalization bounds for deep networks based on loss surface implicit regularization","created":"2022-01-12","cited_by_count":5,"area":null},{"id":"2410.07451","title":"Collective variables of neural networks: empirical time evolution and scaling laws","created":"2024-10-09","cited_by_count":3,"area":null},{"id":"2304.11237","title":"Effective Neural Network $L_0$ Regularization With BinMask","created":"2023-04-21","cited_by_count":2,"area":null},{"id":"2408.14677","title":"Can Optimization Trajectories Explain Multi-Task Transfer?","created":"2024-08-26","cited_by_count":2,"area":null},{"id":"2311.02818","title":"Signal Processing Meets SGD: From Momentum to Filter","created":"2023-11-06","cited_by_count":1,"area":null},{"id":"2511.04981","title":"Scaling depth capacity via zero/one-layer model expansion","created":"2025-11-07","cited_by_count":1,"area":null},{"id":"2603.06120","title":"Dynamic Momentum Recalibration in Online Gradient Learning","created":"2026-03-06","cited_by_count":1,"area":null},{"id":"2603.10079","title":"Large Spikes in Stochastic Gradient Descent: A Large-Deviations View","created":"2026-03-10","cited_by_count":1,"area":null},{"id":"2603.13872","title":"On Interpolation Formulas Describing Neural Network Generalization","created":"2026-03-14","cited_by_count":1,"area":null},{"id":"2504.01737","title":"Enlightenment Period Improving DNN Performance","created":"2025-04-02","cited_by_count":0,"area":null},{"id":"2506.14806","title":"Heavy-Ball Momentum Method in Continuous Time and Discretization Error Analysis","created":"2025-06-03","cited_by_count":0,"area":null}],"next_cursor":null}