{"total":13,"rows":[{"id":"2212.14034","title":"Cramming: Training a Language Model on a Single GPU in One Day","created":"2022-12-28","cited_by_count":81,"area":null},{"id":"2206.01029","title":"Trajectory of Mini-Batch Momentum: Batch Size Saturation and Convergence in High Dimensions","created":"2022-06-02","cited_by_count":19,"area":null},{"id":"2402.11215","title":"AdAdaGrad: Adaptive Batch Size Schemes for Adaptive Gradient Methods","created":"2024-02-17","cited_by_count":8,"area":null},{"id":"2411.00999","title":"Normalization Layer Per-Example Gradients are Sufficient to Predict Gradient Noise Scale in Transformers","created":"2024-11-01","cited_by_count":7,"area":null},{"id":"2406.13936","title":"Communication-Efficient Adaptive Batch Size Strategies for Distributed Local Gradient Methods","created":"2024-06-20","cited_by_count":4,"area":null},{"id":"2412.21124","title":"Adaptive Batch Size Schedules for Distributed Training of Language Models with Data and Model Parallelism","created":"2024-12-30","cited_by_count":4,"area":null},{"id":"2103.17132","title":"Empirically explaining SGD from a line search perspective","created":"2021-03-31","cited_by_count":2,"area":null},{"id":"2410.07502","title":"Adaptive Batch Size for Privately Finding Second-Order Stationary Points","created":"2024-10-10","cited_by_count":2,"area":null},{"id":"2105.07181","title":"Drill the Cork of Information Bottleneck by Inputting the Most Important Data","created":"2021-05-15","cited_by_count":1,"area":null},{"id":"2406.17954","title":"Why Line Search when you can Plane Search? SO-Friendly Neural Networks allow Per-Iteration Optimization of Learning and Momentum Rates for Every Layer","created":"2024-06-25","cited_by_count":1,"area":null},{"id":"2108.13880","title":"Using a one dimensional parabolic model of the full-batch loss to estimate learning rates during training","created":"2021-08-31","cited_by_count":0,"area":null},{"id":"2404.16917","title":"Grad Queue : A probabilistic framework to reinforce sparse gradients","created":"2024-04-25","cited_by_count":0,"area":null},{"id":"2606.07841","title":"Large-scale empirical tuning and comparison of default optimizers for variational inference","created":"2026-06-05","cited_by_count":0,"area":null}],"next_cursor":null}