{"total":86,"rows":[{"id":"2103.00065","title":"Gradient Descent on Neural Networks Typically Occurs at the Edge of Stability","created":"2021-02-26","cited_by_count":427,"area":null},{"id":"2106.01548","title":"When Vision Transformers Outperform ResNets without Pre-training or Strong Data Augmentations","created":"2021-06-03","cited_by_count":260,"area":null},{"id":"2205.14959","title":"Dataset Condensation via Efficient Synthetic-Data Parameterization","created":"2022-05-30","cited_by_count":188,"area":null},{"id":"2209.15594","title":"Self-Stabilization: The Implicit Bias of Gradient Descent at the Edge of Stability","created":"2022-09-30","cited_by_count":155,"area":null},{"id":"2112.09153","title":"An Empirical Investigation of the Role of Pre-training in Lifelong Learning","created":"2021-12-16","cited_by_count":134,"area":null},{"id":"2207.14484","title":"Adaptive Gradient Methods at the Edge of Stability","created":"2022-07-29","cited_by_count":101,"area":null},{"id":"2203.11834","title":"Improving Generalization in Federated Learning by Seeking Flat Minima","created":"2022-03-22","cited_by_count":98,"area":null},{"id":"2204.01050","title":"Understanding the unstable convergence of gradient descent","created":"2022-04-03","cited_by_count":86,"area":null},{"id":"2302.10911","title":"Revisiting Weighted Aggregation in Federated Learning with Neural Networks","created":"2023-02-14","cited_by_count":58,"area":null},{"id":"2212.07469","title":"Learning threshold neurons via the \"edge of stability\"","created":"2022-12-14","cited_by_count":51,"area":null},{"id":"2102.04828","title":"Consensus Control for Decentralized Deep Learning","created":"2021-02-09","cited_by_count":49,"area":null},{"id":"2507.07101","title":"Small Batch Size Training for Language Models: When Vanilla SGD Works, and Why Gradient Accumulation Is Wasteful","created":"2025-07-09","cited_by_count":41,"area":null},{"id":"2302.08982","title":"(S)GD over Diagonal Linear Networks: Implicit Regularisation, Large Stepsizes and Edge of Stability","created":"2023-02-17","cited_by_count":36,"area":null},{"id":"2405.16002","title":"Does SGD really happen in tiny subspaces?","created":"2024-05-25","cited_by_count":36,"area":null},{"id":"2306.04815","title":"Catapults in SGD: spikes in the training loss and their impact on generalization through feature learning","created":"2023-06-07","cited_by_count":31,"area":null},{"id":"2302.01172","title":"STEP: Learning N:M Structured Sparsity Masks from Scratch with Precondition","created":"2023-02-02","cited_by_count":26,"area":null},{"id":"2209.14105","title":"Exploring the Relationship between Architecture and Adversarially Robust Generalization","created":"2022-09-28","cited_by_count":23,"area":null},{"id":"2402.17457","title":"Super Consistency of Neural Network Landscapes and Learning Rate Transfer","created":"2024-02-27","cited_by_count":23,"area":null},{"id":"2203.17008","title":"It's All In the Teacher: Zero-Shot Quantization Brought Closer to the Teacher","created":"2022-03-31","cited_by_count":20,"area":null},{"id":"2107.09133","title":"The Limiting Dynamics of SGD: Modified Loss, Phase Space Oscillations, and Anomalous Diffusion","created":"2021-07-19","cited_by_count":19,"area":null},{"id":"2209.03695","title":"Training Scale-Invariant Neural Networks on the Sphere Can Happen in Three Regimes","created":"2022-09-08","cited_by_count":19,"area":null},{"id":"2302.12250","title":"Phase diagram of early training dynamics in deep neural networks: effect of the learning rate, depth, and width","created":"2023-02-23","cited_by_count":19,"area":null},{"id":"2503.18595","title":"Adaptive Unimodal Regulation for Balanced Multimodal Information Acquisition","created":"2025-03-24","cited_by_count":19,"area":null},{"id":"2212.08272","title":"Communication-Efficient Federated Learning for Heterogeneous Edge Devices Based on Adaptive Gradient Quantization","created":"2022-12-16","cited_by_count":14,"area":null},{"id":"2607.21716","title":"A Defense of the Quadratic Model","created":"2026-07-23","cited_by_count":14,"area":null},{"id":"2311.04163","title":"Outliers with Opposing Signals Have an Outsized Effect on Neural Network Optimization","created":"2023-11-07","cited_by_count":13,"area":null},{"id":"2505.02809","title":"Towards Quantifying the Hessian Structure of Neural Networks","created":"2025-05-05","cited_by_count":13,"area":null},{"id":"2506.04805","title":"Adaptive Preconditioners Trigger Loss Spikes in Adam","created":"2025-06-05","cited_by_count":13,"area":null},{"id":"2302.01952","title":"On a continuous time model of gradient descent dynamics and instability in deep learning","created":"2023-02-03","cited_by_count":11,"area":null},{"id":"2305.15850","title":"Stochastic Modified Equations and Dynamics of Dropout Algorithm","created":"2023-05-25","cited_by_count":11,"area":null},{"id":"2306.07850","title":"Exact Mean Square Linear Stability Analysis for SGD","created":"2023-06-13","cited_by_count":11,"area":null},{"id":"2205.15142","title":"Special Properties of Gradient Descent with Large Learning Rates","created":"2022-05-30","cited_by_count":10,"area":null},{"id":"2604.14108","title":"Momentum Further Constrains Sharpness at the Edge of Stochastic Stability","created":"2026-04-15","cited_by_count":10,"area":null},{"id":"2304.05260","title":"Re-Weighted Softmax Cross-Entropy to Control Forgetting in Federated Learning","created":"2023-04-11","cited_by_count":9,"area":null},{"id":"2109.05613","title":"Critical Learning Periods in Federated Learning","created":"2021-09-12","cited_by_count":8,"area":null},{"id":"2407.06183","title":"Stepping on the Edge: Curvature Aware Learning Rate Tuners","created":"2024-07-08","cited_by_count":8,"area":null},{"id":"2106.03091","title":"Regularization in ResNet with Stochastic Depth","created":"2021-06-06","cited_by_count":7,"area":null},{"id":"2307.07950","title":"Accelerating Distributed ML Training via Selective Synchronization","created":"2023-07-16","cited_by_count":7,"area":null},{"id":"2201.09209","title":"Weight Expansion: A New Perspective on Dropout and Generalization","created":"2022-01-23","cited_by_count":6,"area":null},{"id":"2406.01468","title":"Understanding Token Probability Encoding in Output Embeddings","created":"2024-06-03","cited_by_count":6,"area":null},{"id":"2410.22113","title":"Where Do Large Learning Rates Lead Us?","created":"2024-10-29","cited_by_count":6,"area":null},{"id":"2306.07104","title":"Unveiling the Hessian's Connection to the Decision Boundary","created":"2023-06-12","cited_by_count":5,"area":null},{"id":"2506.06940","title":"Understanding Sharpness Dynamics in NN Training with a Minimalist Example: The Effects of Dataset Difficulty, Depth, Stochasticity, and More","created":"2025-06-07","cited_by_count":5,"area":null},{"id":"2601.09000","title":"Universal Dynamics of Warmup Stable Decay: understanding WSD beyond Transformers","created":"2026-01-13","cited_by_count":5,"area":null},{"id":"2206.00823","title":"Beyond accuracy: generalization properties of bio-plausible temporal credit assignment rules","created":"2022-06-02","cited_by_count":3,"area":null},{"id":"2502.18153","title":"SASSHA: Sharpness-aware Adaptive Second-order Optimization with Stable Hessian Approximation","created":"2025-02-25","cited_by_count":3,"area":null},{"id":"2602.14789","title":"On the Stability of Nonlinear Dynamics in GD and SGD: Beyond Quadratic Potentials","created":"2026-02-16","cited_by_count":3,"area":null},{"id":"2604.20614","title":"Too Sharp, Too Sure: When Calibration Follows Curvature","created":"2026-04-22","cited_by_count":3,"area":null},{"id":"2606.18080","title":"Edge Flow: A Tractable and Predictive Continuous-Time Model for Gradient Descent at the Edge of Stability","created":"2026-06-16","cited_by_count":3,"area":null},{"id":"2103.17132","title":"Empirically explaining SGD from a line search perspective","created":"2021-03-31","cited_by_count":2,"area":null},{"id":"2506.18588","title":"Optimization-Induced Dynamics of Lipschitz Continuity in Neural Networks","created":"2025-06-23","cited_by_count":2,"area":null},{"id":"2601.01465","title":"Leveraging Flatness to Improve Information-Theoretic Generalization Bounds for SGD","created":"2026-01-04","cited_by_count":2,"area":null},{"id":"2306.09991","title":"Evolutionary Algorithms in the Light of SGD: Limit Equivalence, Minima Flatness, and Transfer Learning","created":"2023-05-20","cited_by_count":1,"area":null},{"id":"2310.17972","title":"EcoLearn: Optimizing the Carbon Footprint of Federated Learning","created":"2023-10-27","cited_by_count":1,"area":null},{"id":"2404.19725","title":"CurvFed: Curvature-Aligned Federated Learning for Fairness without Demographics","created":"2024-04-30","cited_by_count":1,"area":null},{"id":"2405.12493","title":"Visualizing, Rethinking, and Mining the Loss Landscape of Deep Neural Networks","created":"2024-05-21","cited_by_count":1,"area":null},{"id":"2602.05065","title":"Does SGD Seek Flatness or Sharpness? An Exactly Solvable Model","created":"2026-02-04","cited_by_count":1,"area":null},{"id":"2603.13373","title":"Ethical Fairness in Ubiquitous Health Sensing without Known Attributes","created":"2026-03-10","cited_by_count":1,"area":null},{"id":"2604.21016","title":"SGD at the Edge of Stability: The Stochastic Sharpness Gap","created":"2026-04-22","cited_by_count":1,"area":null},{"id":"2605.16622","title":"Does Weight Decay Enhance Training Stability?","created":"2026-05-15","cited_by_count":1,"area":null},{"id":"2606.30226","title":"Characterizing Optimizer-Dependent Training Dynamics Through Hessian Eigenvector Displacement and Localization","created":"2026-06-29","cited_by_count":1,"area":null},{"id":"2607.21005","title":"Weight-norm Criticality: A Mechanism for Loss Spikes Induced by the Normalization and Weight Decay","created":"2026-07-23","cited_by_count":1,"area":null},{"id":"2608.18415","title":"The Road Taken: The Role of Optimizers at the Edge of Stability","created":"2026-08-19","cited_by_count":1,"area":null},{"id":"2608.20638","title":"Adam at the Edge of Stability: Adaptive Feedback, Provable Oscillation, and Gradient Reversal","created":"2026-08-21","cited_by_count":1,"area":null},{"id":"2105.14526","title":"LRTuner: A Learning Rate Tuner for Deep Neural Networks","created":"2021-05-30","cited_by_count":0,"area":null},{"id":"2201.07934","title":"Complexity from Adaptive-Symmetries Breaking: Global Minima in the Statistical Mechanics of Deep Neural Networks","created":"2022-01-03","cited_by_count":0,"area":null},{"id":"2205.08231","title":"Hyper-Learning for Gradient-Based Batch Size Adaptation","created":"2022-05-17","cited_by_count":0,"area":null},{"id":"2305.18490","title":"SANE: The phases of gradient descent through Sharpness Adjusted Number of Effective parameters","created":"2023-05-29","cited_by_count":0,"area":null},{"id":"2405.18042","title":"Visualizing the loss landscape of Self-supervised Vision Transformer","created":"2024-05-28","cited_by_count":0,"area":null},{"id":"2410.07719","title":"How Learning Dynamics Drive Adversarially Robust Generalization?","created":"2024-10-10","cited_by_count":0,"area":null},{"id":"2412.13928","title":"Subspace Langevin Monte Carlo","created":"2024-12-18","cited_by_count":0,"area":null},{"id":"2509.23052","title":"Optimization as a Dynamical System: Generative Schedules from Latent ODEs","created":"2025-09-27","cited_by_count":0,"area":null},{"id":"2601.10251","title":"X-SAM: Boosting Sharpness-Aware Minimization with Dominant-Eigenvector Gradient Correction","created":"2026-01-15","cited_by_count":0,"area":null},{"id":"2603.02620","title":"Same Error, Different Function: The Optimizer as an Implicit Prior in Financial Time Series","created":"2026-03-03","cited_by_count":0,"area":null},{"id":"2603.04194","title":"Noise-aware Client Selection for carbon-efficient Federated Learning via Gradient Norm Thresholding","created":"2026-03-04","cited_by_count":0,"area":null},{"id":"2603.18112","title":"Tula: Optimizing Time, Cost, and Generalization in Distributed Large-Batch Training","created":"2026-03-18","cited_by_count":0,"area":null},{"id":"2605.01989","title":"DBLP: Phase-Aware Bounded-Loss Transport for Burst-Resilient Distributed ML Training","created":"2026-05-03","cited_by_count":0,"area":null},{"id":"2605.22644","title":"Why SGD is not Brownian Motion: A New Perspective on Stochastic Dynamics","created":"2026-05-21","cited_by_count":0,"area":null},{"id":"2606.04212","title":"Edge of Stability Selectively Shapes Learning Across the Data Distribution","created":"2026-06-02","cited_by_count":0,"area":null},{"id":"2608.15901","title":"Layers Matter: Why Continual Learning Regularization Should Be Layer-Adaptive","created":"2026-08-16","cited_by_count":0,"area":null},{"id":"2609.01034","title":"The Multiple Timescales of Gradient Descent on the Edge of Stability: A Perturbative Derivation of the Central Flow","created":"2026-09-01","cited_by_count":0,"area":null},{"id":"2609.18314","title":"Beyond Quadratic Loss: The Stability Phase Diagram of Adam","created":"2026-09-16","cited_by_count":0,"area":null},{"id":"2609.32290","title":"A Journey to the Edge of Stability","created":"2026-09-26","cited_by_count":0,"area":null},{"id":"2609.34915","title":"Muon Sublates the Edge of Stability in LLM Pretraining","created":"2026-09-28","cited_by_count":0,"area":null},{"id":"2609.39767","title":"How Does Local Landscape Geometry Evolve in Language Model Pre-Training?","created":"2026-09-30","cited_by_count":0,"area":null},{"id":"2610.13524","title":"Simulating Training Spikes of Deep Neural Networks by Layer-wise Random Feature Models","created":"2026-10-09","cited_by_count":0,"area":null}],"next_cursor":null}