{"total":28,"rows":[{"id":"2305.17333","title":"Fine-Tuning Language Models with Just Forward Passes","created":"2023-05-27","cited_by_count":345,"area":null},{"id":"2212.14034","title":"Cramming: Training a Language Model on a Single GPU in One Day","created":"2022-12-28","cited_by_count":81,"area":null},{"id":"2309.06497","title":"A Distributed Data-Parallel PyTorch Implementation of the Distributed Shampoo Optimizer for Training Neural Networks At-Scale","created":"2023-09-12","cited_by_count":77,"area":null},{"id":"2102.04396","title":"SGD in the Large: Average-case Analysis, Asymptotics, and Stepsize Criticality","created":"2021-02-08","cited_by_count":35,"area":null},{"id":"2102.05320","title":"An Adaptive Stochastic Sequential Quadratic Programming with Differentiable Exact Augmented Lagrangians","created":"2021-02-10","cited_by_count":25,"area":null},{"id":"2109.11502","title":"Inequality Constrained Stochastic Nonlinear Optimization via Active-Set Sequential Quadratic Programming","created":"2021-09-23","cited_by_count":17,"area":null},{"id":"2107.07572","title":"Globally Convergent Multilevel Training of Deep Residual Networks","created":"2021-07-15","cited_by_count":11,"area":null},{"id":"2402.11215","title":"AdAdaGrad: Adaptive Batch Size Schemes for Adaptive Gradient Methods","created":"2024-02-17","cited_by_count":8,"area":null},{"id":"2102.06604","title":"Cockpit: A Practical Debugging Tool for the Training of Deep Neural Networks","created":"2021-02-12","cited_by_count":7,"area":null},{"id":"2111.07952","title":"Stochastic Gradient Line Bayesian Optimization for Efficient Noise-Robust Optimization of Parameterized Quantum Circuits","created":"2021-11-15","cited_by_count":7,"area":null},{"id":"2503.24121","title":"IMPACT: A Generic Semantic Loss for Multimodal Medical Image Registration","created":"2025-03-31","cited_by_count":5,"area":null},{"id":"2109.12213","title":"Adaptive Sampling Quasi-Newton Methods for Zeroth-Order Stochastic Optimization","created":"2021-09-24","cited_by_count":4,"area":null},{"id":"2406.13936","title":"Communication-Efficient Adaptive Batch Size Strategies for Distributed Local Gradient Methods","created":"2024-06-20","cited_by_count":4,"area":null},{"id":"2412.21124","title":"Adaptive Batch Size Schedules for Distributed Training of Language Models with Data and Model Parallelism","created":"2024-12-30","cited_by_count":4,"area":null},{"id":"2402.05264","title":"AdaBatchGrad: Combining Adaptive Batch Size and Adaptive Step Size","created":"2024-02-07","cited_by_count":3,"area":null},{"id":"2311.18787","title":"Communication-Efficient Federated Optimization over Semi-Decentralized Networks","created":"2023-11-30","cited_by_count":2,"area":null},{"id":"2602.03001","title":"Adaptive Batch Sizes Using Non-Euclidean Gradient Noise Scales for Stochastic Sign and Spectral Descent","created":"2026-02-03","cited_by_count":2,"area":null},{"id":"2103.04392","title":"A Retrospective Approximation Approach for Smooth Stochastic Optimization","created":"2021-03-07","cited_by_count":1,"area":null},{"id":"2111.14761","title":"Adaptive First- and Second-Order Algorithms for Large-Scale Machine Learning","created":"2021-11-29","cited_by_count":1,"area":null},{"id":"2104.12949","title":"Discriminative Bayesian filtering lends momentum to the stochastic Newton method for minimizing log-convex functions","created":"2021-04-27","cited_by_count":0,"area":null},{"id":"2105.10915","title":"GOALS: Gradient-Only Approximations for Line Searches Towards Robust and Consistent Training of Deep Neural Networks","created":"2021-05-23","cited_by_count":0,"area":null},{"id":"2109.10933","title":"On the equivalence of different adaptive batch size selection strategies for stochastic gradient descent methods","created":"2021-09-22","cited_by_count":0,"area":null},{"id":"2111.07058","title":"Bolstering Stochastic Gradient Descent with Model Building","created":"2021-11-13","cited_by_count":0,"area":null},{"id":"2206.06531","title":"A Stochastic Proximal Method for Nonsmooth Regularized Finite Sum Optimization","created":"2022-06-14","cited_by_count":0,"area":null},{"id":"2212.01848","title":"Convergence of ease-controlled Random Reshuffling gradient Algorithms under Lipschitz smoothness","created":"2022-12-04","cited_by_count":0,"area":null},{"id":"2508.18182","title":"AdLoCo: adaptive batching significantly improves communications efficiency and convergence for Large Language Models","created":"2025-08-25","cited_by_count":0,"area":null},{"id":"2601.20422","title":"Guiding the Recommender: Information-Aware Auto-Bidding for Content Promotion","created":"2026-01-28","cited_by_count":0,"area":null},{"id":"2610.02355","title":"Why Does Adaptive Batching Help LLM Pretraining? A Perspective from Unbounded Variance","created":"2026-10-01","cited_by_count":0,"area":null}],"next_cursor":null}