{"total":121,"rows":[{"id":"2102.06571","title":"Bayesian Neural Network Priors Revisited","created":"2021-02-12","cited_by_count":121,"area":null},{"id":"2111.13171","title":"Intrinsic Dimension, Persistent Homology and Generalization in Neural Networks","created":"2021-11-25","cited_by_count":70,"area":null},{"id":"2106.03795","title":"Heavy Tails in SGD and Compressibility of Overparametrized Neural Networks","created":"2021-06-07","cited_by_count":44,"area":null},{"id":"2202.02831","title":"Anticorrelated Noise Injection for Improved Generalization","created":"2022-02-06","cited_by_count":42,"area":null},{"id":"2506.04192","title":"Lions and Muons: Optimization via Stochastic Frank-Wolfe under Heavy-Tailed Noise","created":"2025-06-04","cited_by_count":41,"area":null},{"id":"2102.04396","title":"SGD in the Large: Average-case Analysis, Asymptotics, and Stepsize Criticality","created":"2021-02-08","cited_by_count":35,"area":null},{"id":"2102.10346","title":"Convergence Rates of Stochastic Gradient Descent under Infinite Noise Variance","created":"2021-02-20","cited_by_count":35,"area":null},{"id":"2103.01519","title":"Hessian Eigenspectra of More Realistic Nonlinear Models","created":"2021-03-02","cited_by_count":33,"area":null},{"id":"2104.10719","title":"A Fully Spiking Hybrid Neural Network for Energy-Efficient Object Detection","created":"2021-04-21","cited_by_count":31,"area":null},{"id":"2105.09557","title":"Power-law escape rate of SGD","created":"2021-05-20","cited_by_count":29,"area":null},{"id":"2102.09385","title":"Convergence of stochastic gradient descent schemes for Lojasiewicz-landscapes","created":"2021-02-16","cited_by_count":28,"area":null},{"id":"2108.00781","title":"Generalization Bounds using Lower Tail Exponents in Stochastic Optimizers","created":"2021-08-02","cited_by_count":27,"area":null},{"id":"2205.07069","title":"Homogenization of SGD in high-dimensions: Exact dynamics and generalization properties","created":"2022-05-14","cited_by_count":27,"area":null},{"id":"2306.03824","title":"Understanding Generalization of Federated Learning via Stability: Heterogeneity Matters","created":"2023-06-06","cited_by_count":27,"area":null},{"id":"2309.16314","title":"A Primer on Bayesian Neural Networks: Review and Debates","created":"2023-09-28","cited_by_count":27,"area":null},{"id":"2202.11632","title":"Mirror Descent Strikes Again: Optimal Stochastic Convex Optimization under Infinite Noise Variance","created":"2022-02-23","cited_by_count":24,"area":null},{"id":"2106.04881","title":"Fractal Structure and Generalization Properties of Stochastic Optimization Algorithms","created":"2021-06-09","cited_by_count":23,"area":null},{"id":"2206.07252","title":"Implicit Regularization or Implicit Conditioning? Exact Risk Trajectories of SGD in High Dimensions","created":"2022-06-15","cited_by_count":23,"area":null},{"id":"2312.00359","title":"Temperature Balancing, Layer-wise Weight Analysis, and Neural Network Training","created":"2023-12-01","cited_by_count":20,"area":null},{"id":"2504.09951","title":"Towards Weaker Variance Assumptions for Stochastic Optimization","created":"2025-04-14","cited_by_count":17,"area":null},{"id":"2201.13011","title":"On the Power-Law Hessian Spectrums in Deep Learning","created":"2022-01-31","cited_by_count":16,"area":null},{"id":"2204.02593","title":"Nonlinear gradient mappings and stochastic optimization: A general framework with applications to heavy-tail noise","created":"2022-04-06","cited_by_count":16,"area":null},{"id":"2301.11885","title":"Algorithmic Stability of Heavy-Tailed SGD with General Loss Functions","created":"2023-01-27","cited_by_count":15,"area":null},{"id":"2205.08187","title":"Deep neural networks with dependent weights: Gaussian Process mixture limit, heavy tails, sparsity and compressibility","created":"2022-05-17","cited_by_count":13,"area":null},{"id":"2212.02083","title":"On the Overlooked Structure of Stochastic Gradients","created":"2022-12-05","cited_by_count":13,"area":null},{"id":"2502.07923","title":"Sign Operator for Coping with Heavy-Tailed Noise in Non-Convex Optimization: High Probability Bounds Under $(L_0, L_1)$-Smoothness","created":"2025-02-11","cited_by_count":13,"area":null},{"id":"2102.07006","title":"Asymmetric Heavy Tails and Implicit Bias in Gaussian Noise Injections","created":"2021-02-13","cited_by_count":12,"area":null},{"id":"2106.08414","title":"On the Sample Complexity and Metastability of Heavy-tailed Policy Search in Continuous Control","created":"2021-06-15","cited_by_count":12,"area":null},{"id":"2111.13331","title":"Impact of classification difficulty on the weight matrices spectra in Deep Learning and application to early-stopping","created":"2021-11-26","cited_by_count":12,"area":null},{"id":"2206.01274","title":"Algorithmic Stability of Heavy-Tailed Stochastic Gradient Descent on Least Squares","created":"2022-06-02","cited_by_count":12,"area":null},{"id":"2211.10691","title":"Two Facets of SDE Under an Information-Theoretic Lens: Generalization of SGD via Training Trajectories and via Terminal States","created":"2022-11-19","cited_by_count":11,"area":null},{"id":"2405.13453","title":"A Huber Loss Minimization Approach to Mean Estimation under User-level Differential Privacy","created":"2024-05-22","cited_by_count":11,"area":null},{"id":"2410.12178","title":"Model Balancing Helps Low-data Training and Fine-tuning","created":"2024-10-16","cited_by_count":11,"area":null},{"id":"2506.11214","title":"Complexity of normalized stochastic first-order methods with momentum under heavy-tailed noise","created":"2025-06-12","cited_by_count":11,"area":null},{"id":"2205.15142","title":"Special Properties of Gradient Descent with Large Learning Rates","created":"2022-05-30","cited_by_count":10,"area":null},{"id":"2210.00690","title":"Taming Fat-Tailed (\"Heavier-Tailed'' with Potentially Infinite Variance) Noise in Federated Learning","created":"2022-10-03","cited_by_count":10,"area":null},{"id":"2506.03470","title":"Models of Heavy-Tailed Mechanistic Universality","created":"2025-06-04","cited_by_count":10,"area":null},{"id":"2506.06280","title":"Eigenspectrum Analysis of Neural Networks without Aspect Ratio Bias","created":"2025-06-06","cited_by_count":10,"area":null},{"id":"2306.11455","title":"Provably Robust Temporal Difference Learning for Heavy-Tailed Rewards","created":"2023-06-20","cited_by_count":9,"area":null},{"id":"2404.17442","title":"Uniform Generalization Bounds on Data-Dependent Hypothesis Sets via PAC-Bayesian Theory on Random Sets","created":"2024-04-26","cited_by_count":9,"area":null},{"id":"2406.04657","title":"From Spikes to Heavy Tails: Unveiling the Spectral Evolution of Neural Networks","created":"2024-06-07","cited_by_count":9,"area":null},{"id":"2105.14677","title":"Characterization of Generalizability of Spike Timing Dependent Plasticity trained Spiking Neural Networks","created":"2021-05-31","cited_by_count":8,"area":null},{"id":"2107.11774","title":"SGD with a Constant Large Learning Rate Can Converge to Local Maxima","created":"2021-07-25","cited_by_count":8,"area":null},{"id":"2303.13093","title":"Type-II Saddles and Probabilistic Stability of Stochastic Gradient Descent","created":"2023-03-23","cited_by_count":8,"area":null},{"id":"2407.20209","title":"Characterizing Dynamical Stability of Stochastic Gradient Descent in Overparameterized Learning","created":"2024-07-29","cited_by_count":8,"area":null},{"id":"2410.15637","title":"Large Deviation Upper Bounds and Improved MSE Rates of Nonlinear SGD: Heavy-tailed Noise and Power of Symmetry","created":"2024-10-21","cited_by_count":7,"area":null},{"id":"2201.02313","title":"Stochastic Saddle Point Problems with Decision-Dependent Distributions","created":"2022-01-07","cited_by_count":6,"area":null},{"id":"2205.06689","title":"Heavy-Tail Phenomenon in Decentralized SGD","created":"2022-05-13","cited_by_count":6,"area":null},{"id":"2209.09162","title":"On the Theoretical Properties of Noise Correlation in Stochastic Optimization","created":"2022-09-19","cited_by_count":5,"area":null},{"id":"2305.01143","title":"Understanding the Generalization Ability of Deep Learning Algorithms: A Kernelized Renyi's Entropy Perspective","created":"2023-05-02","cited_by_count":5,"area":null},{"id":"2307.13680","title":"High Probability Analysis for Non-Convex Stochastic Optimization with Clipping","created":"2023-07-25","cited_by_count":5,"area":null},{"id":"2405.17529","title":"Clip Body and Tail Separately: High Probability Guarantees for DPSGD with Heavy Tails","created":"2024-05-27","cited_by_count":5,"area":null},{"id":"2502.17009","title":"Unbiased and Sign Compression in Distributed Learning: Comparing Noise Resilience via SDEs","created":"2025-02-24","cited_by_count":5,"area":null},{"id":"2510.02676","title":"To Compress or Not? Pushing the Frontier of Lossless GenAI Model Weights Compression with Exponent Concentration","created":"2025-10-03","cited_by_count":5,"area":null},{"id":"2604.16620","title":"Lower Bounds and Proximally Anchored SGD for Non-Convex Minimization Under Unbounded Variance","created":"2026-04-17","cited_by_count":5,"area":null},{"id":"2312.00427","title":"From Mutual Information to Expected Dynamics: New Generalization Bounds for Heavy-Tailed SGD","created":"2023-12-01","cited_by_count":4,"area":null},{"id":"2402.01382","title":"Emergence of heavy tails in homogenized stochastic gradient descent","created":"2024-02-02","cited_by_count":4,"area":null},{"id":"2406.00396","title":"Stochastic Resetting Mitigates Latent Gradient Bias of SGD from Label Noise","created":"2024-06-01","cited_by_count":4,"area":null},{"id":"2410.16340","title":"Limit Theorems for Stochastic Gradient Descent with Infinite Variance","created":"2024-10-21","cited_by_count":4,"area":null},{"id":"2506.14673","title":"Uniform Mean Estimation for Heavy-Tailed Distributions via Median-of-Means","created":"2025-06-17","cited_by_count":4,"area":null},{"id":"2510.11676","title":"Accelerated stochastic first-order method for convex optimization under heavy-tailed noise","created":"2025-10-13","cited_by_count":4,"area":null},{"id":"2105.11025","title":"Compressing Heavy-Tailed Weight Matrices for Non-Vacuous Generalization Bounds","created":"2021-05-23","cited_by_count":3,"area":null},{"id":"2310.18455","title":"Approximate Heavy Tails in Offline (Multi-Pass) Stochastic Gradient Descent","created":"2023-10-27","cited_by_count":3,"area":null},{"id":"2407.02322","title":"Stochastic Differential Equations models for Least-Squares Stochastic Gradient Descent","created":"2024-07-02","cited_by_count":3,"area":null},{"id":"2507.05164","title":"A Dynamical Systems Perspective on the Analysis of Neural Networks","created":"2025-07-07","cited_by_count":3,"area":null},{"id":"2507.09093","title":"Sharp High-Probability Rates for Nonlinear SGD under Heavy-Tailed Noise via Symmetrization","created":"2025-07-12","cited_by_count":3,"area":null},{"id":"2208.03066","title":"Tailoring to the Tails: Risk Measures for Fine-Grained Tail Sensitivity","created":"2022-08-05","cited_by_count":2,"area":null},{"id":"2302.05516","title":"Cyclic and Randomized Stepsizes Invoke Heavier Tails in SGD than Constant Stepsize","created":"2023-02-10","cited_by_count":2,"area":null},{"id":"2306.09262","title":"A Heavy-Tailed Algebra for Probabilistic Programming","created":"2023-06-15","cited_by_count":2,"area":null},{"id":"2311.08745","title":"Using Stochastic Gradient Descent to Smooth Nonconvex Functions: Analysis of Implicit Graduated Optimization","created":"2023-11-15","cited_by_count":2,"area":null},{"id":"2402.05101","title":"Tighter Generalisation Bounds via Interpolation","created":"2024-02-07","cited_by_count":2,"area":null},{"id":"2403.13868","title":"Analysing heavy-tail properties of Stochastic Gradient Descent by means of Stochastic Recurrence Equations","created":"2024-03-20","cited_by_count":2,"area":null},{"id":"2502.07584","title":"Generalization Bounds for Markov Algorithms through Entropy Flow Computations","created":"2025-02-11","cited_by_count":2,"area":null},{"id":"2506.12903","title":"Variational Learning Finds Flatter Solutions at the Edge of Stability","created":"2025-06-15","cited_by_count":2,"area":null},{"id":"2507.17748","title":"Large Learning Rates Simultaneously Achieve Robustness to Spurious Correlations and Compressibility","created":"2025-07-23","cited_by_count":2,"area":null},{"id":"2507.20560","title":"Statistical Inference for Differentially Private Stochastic Gradient Descent","created":"2025-07-28","cited_by_count":2,"area":null},{"id":"2509.17304","title":"SPRINT: Stochastic Performative Prediction With Variance Reduction","created":"2025-09-22","cited_by_count":2,"area":null},{"id":"2511.04456","title":"Federated Stochastic Minimax Optimization under Heavy-Tailed Noises","created":"2025-11-06","cited_by_count":2,"area":null},{"id":"2601.19379","title":"Optimal Asynchronous Stochastic Nonconvex Optimization under Heavy-Tailed Noise","created":"2026-01-27","cited_by_count":2,"area":null},{"id":"2602.02859","title":"Late-Stage Generalization Collapse in Grokking: Detecting anti-grokking with Weightwatcher","created":"2026-02-02","cited_by_count":2,"area":null},{"id":"2605.18528","title":"Tight Complexity of Muon under Heavy-Tailed Noise","created":"2026-05-18","cited_by_count":2,"area":null},{"id":"2605.19811","title":"LionMuon: Alternating Spectral and Sign Descent for Efficient Training","created":"2026-05-19","cited_by_count":2,"area":null},{"id":"2605.26000","title":"Statistical Inference for Stochastic Gradient Descent: Beyond Finite Variance","created":"2026-05-25","cited_by_count":2,"area":null},{"id":"2106.02713","title":"Learning Curves for SGD on Structured Features","created":"2021-06-04","cited_by_count":1,"area":null},{"id":"2309.13575","title":"Probabilistic Weight Fixing: Large-scale training of neural network weight uncertainties for quantization","created":"2023-09-24","cited_by_count":1,"area":null},{"id":"2406.13871","title":"Robust Time Series Forecasting with Non-Heavy-Tailed Gaussian Loss-Weighted Sampler","created":"2024-06-19","cited_by_count":1,"area":null},{"id":"2408.09891","title":"Differential Private Stochastic Optimization with Heavy-tailed Data: Towards Optimal Rates","created":"2024-08-19","cited_by_count":1,"area":null},{"id":"2410.13954","title":"Nonlinear Stochastic Gradient Descent and Heavy-tailed Noise: A Unified Framework and High-probability Guarantees","created":"2024-10-17","cited_by_count":1,"area":null},{"id":"2503.11808","title":"Understanding the Trade-offs in Accuracy and Uncertainty Quantification: Architecture and Inference Choices in Bayesian Neural Networks","created":"2025-03-14","cited_by_count":1,"area":null},{"id":"2509.13628","title":"Accelerated Gradient Methods with Biased Gradient Estimates: Risk Sensitivity, High-Probability Guarantees, and Large Deviation Bounds","created":"2025-09-17","cited_by_count":1,"area":null},{"id":"2510.01578","title":"Gradient Shaping Beyond Clipping: A Functional Perspective on Update Magnitude Control","created":"2025-10-02","cited_by_count":1,"area":null},{"id":"2510.11018","title":"The Easy Path to Robustness: Coreset Selection using Sample Hardness","created":"2025-10-13","cited_by_count":1,"area":null},{"id":"2510.16074","title":"Early-stopping for Transformer model training","created":"2025-10-17","cited_by_count":1,"area":null},{"id":"2510.18516","title":"Decoding Dynamic Visual Experience from Calcium Imaging via Cell-Pattern-Aware Pretraining","created":"2025-10-21","cited_by_count":1,"area":null},{"id":"2602.05657","title":"Tight Long-Term Tail Decay of (Clipped) SGD in Non-Convex Optimization","created":"2026-02-05","cited_by_count":1,"area":null},{"id":"2606.23676","title":"Open Problem: Is AdamW Effective Under Heavy-Tailed Noise?","created":"2026-06-22","cited_by_count":1,"area":null},{"id":"2105.07222","title":"On the Distributional Properties of Adaptive Gradients","created":"2021-05-15","cited_by_count":0,"area":null},{"id":"2203.10973","title":"A Local Convergence Theory for the Stochastic Gradient Descent Method in Non-Convex Optimization With Non-isolated Local Minima","created":"2022-03-21","cited_by_count":0,"area":null},{"id":"2204.12554","title":"An Empirical Study of the Occurrence of Heavy-Tails in Training a ReLU Gate","created":"2022-04-26","cited_by_count":0,"area":null},{"id":"2306.09624","title":"Power-law Dynamic arising from machine learning","created":"2023-06-16","cited_by_count":0,"area":null}],"next_cursor":"100"}