{"total":281,"rows":[{"id":"2104.14421","title":"What Are Bayesian Neural Network Posteriors Really Like?","created":"2021-04-29","cited_by_count":308,"area":null},{"id":"2203.15332","title":"Balanced Multimodal Learning via On-the-fly Gradient Modulation","created":"2022-03-29","cited_by_count":264,"area":null},{"id":"2101.12176","title":"On the Origin of Implicit Regularization in Stochastic Gradient Descent","created":"2021-01-28","cited_by_count":184,"area":null},{"id":"2106.09647","title":"Deep Learning Through the Lens of Example Difficulty","created":"2021-06-17","cited_by_count":141,"area":null},{"id":"2107.08924","title":"Epistemic Neural Networks","created":"2021-07-19","cited_by_count":120,"area":null},{"id":"2106.11642","title":"Repulsive Deep Ensembles are Bayesian","created":"2021-06-22","cited_by_count":104,"area":null},{"id":"2107.04562","title":"The Bayesian Learning Rule","created":"2021-07-09","cited_by_count":99,"area":null},{"id":"2305.18887","title":"How Does Information Bottleneck Help Deep Learning?","created":"2023-05-30","cited_by_count":93,"area":null},{"id":"2206.07136","title":"Automatic Clipping: Differentially Private Deep Learning Made Easier and Stronger","created":"2022-06-14","cited_by_count":88,"area":null},{"id":"2210.14199","title":"Same Pre-training Loss, Better Downstream: Implicit Bias Matters for Language Models","created":"2022-10-25","cited_by_count":84,"area":null},{"id":"2102.12470","title":"On the Validity of Modeling SGD with Stochastic Differential Equations (SDEs)","created":"2021-02-24","cited_by_count":73,"area":null},{"id":"2206.04030","title":"High-dimensional limit theorems for SGD: Effective dynamics and critical scaling","created":"2022-06-08","cited_by_count":70,"area":null},{"id":"2105.13462","title":"On Linear Stability of SGD and Input-Smoothness of Neural Networks","created":"2021-05-27","cited_by_count":63,"area":null},{"id":"2402.00809","title":"Position: Bayesian Deep Learning is Needed in the Age of Large-Scale AI","created":"2024-02-01","cited_by_count":62,"area":null},{"id":"2303.03108","title":"Gradient Norm Aware Minimization Seeks First-Order Flatness and Improves Generalization","created":"2023-03-03","cited_by_count":57,"area":null},{"id":"2112.15383","title":"Separation of Scales and a Thermodynamic Description of Feature Learning in Some CNNs","created":"2021-12-31","cited_by_count":53,"area":null},{"id":"2107.00940","title":"Inverse-Dirichlet Weighting Enables Reliable Training of Physics Informed Neural Networks","created":"2021-07-02","cited_by_count":43,"area":null},{"id":"2210.01620","title":"SAM as an Optimal Relaxation of Bayes","created":"2022-10-04","cited_by_count":41,"area":null},{"id":"2103.14835","title":"LiBRe: A Practical Bayesian Approach to Adversarial Detection","created":"2021-03-27","cited_by_count":40,"area":null},{"id":"2102.05375","title":"Strength of Minibatch Noise in SGD","created":"2021-02-10","cited_by_count":39,"area":null},{"id":"2207.13129","title":"LGV: Boosting Adversarial Example Transferability from Large Geometric Vicinity","created":"2022-07-26","cited_by_count":39,"area":null},{"id":"2107.10211","title":"Differentiable Annealed Importance Sampling and the Perils of Gradient Noise","created":"2021-07-21","cited_by_count":36,"area":null},{"id":"2303.02749","title":"Revisiting the Noise Model of Stochastic Gradient Descent","created":"2023-03-05","cited_by_count":36,"area":null},{"id":"2110.00641","title":"Batch size-invariance for policy optimization","created":"2021-10-01","cited_by_count":35,"area":null},{"id":"2105.13343","title":"Drawing Multiple Augmentation Samples Per Image During Training Efficiently Decreases Test Error","created":"2021-05-27","cited_by_count":33,"area":null},{"id":"2302.05086","title":"Making Substitute Models More Bayesian Can Enhance Transferability of Adversarial Examples","created":"2023-02-10","cited_by_count":32,"area":null},{"id":"2106.13897","title":"Implicit Gradient Alignment in Distributed and Federated Learning","created":"2021-06-25","cited_by_count":29,"area":null},{"id":"2305.16038","title":"Implicit bias of SGD in $L_{2}$-regularized linear DNNs: One-way jumps from high to low rank","created":"2023-05-25","cited_by_count":29,"area":null},{"id":"2604.21691","title":"There Will Be a Scientific Theory of Deep Learning","created":"2026-04-23","cited_by_count":29,"area":null},{"id":"2103.17182","title":"Positive-Negative Momentum: Manipulating Stochastic Gradient Noise to Improve Generalization","created":"2021-03-31","cited_by_count":28,"area":null},{"id":"2105.10585","title":"Properties of the After Kernel","created":"2021-05-21","cited_by_count":27,"area":null},{"id":"2205.00165","title":"NeuralEF: Deconstructing Kernels by Deep Neural Networks","created":"2022-04-30","cited_by_count":27,"area":null},{"id":"2306.11589","title":"Sampling from Gaussian Process Posteriors using Stochastic Gradient Descent","created":"2023-06-20","cited_by_count":27,"area":null},{"id":"2309.16314","title":"A Primer on Bayesian Neural Networks: Review and Debates","created":"2023-09-28","cited_by_count":27,"area":null},{"id":"2105.07107","title":"An Effective Baseline for Robustness to Distributional Shift","created":"2021-05-15","cited_by_count":25,"area":null},{"id":"2109.03839","title":"Sqrt(d) Dimension Dependence of Langevin Monte Carlo","created":"2021-09-08","cited_by_count":25,"area":null},{"id":"2111.01968","title":"A Survey on Epistemic (Model) Uncertainty in Supervised Learning: Recent Advances and Applications","created":"2021-11-03","cited_by_count":24,"area":null},{"id":"2112.03215","title":"Multi-scale Feature Learning Dynamics: Insights for Double Descent","created":"2021-12-06","cited_by_count":24,"area":null},{"id":"2206.07252","title":"Implicit Regularization or Implicit Conditioning? Exact Risk Trajectories of SGD in High Dimensions","created":"2022-06-15","cited_by_count":23,"area":null},{"id":"2301.08203","title":"An SDE for Modeling SAM: Theory and Insights","created":"2023-01-19","cited_by_count":22,"area":null},{"id":"2301.02312","title":"Training trajectories, mini-batch losses and the curious role of the learning rate","created":"2023-01-05","cited_by_count":21,"area":null},{"id":"2501.11039","title":"Model Predictive Task Sampling for Efficient and Robust Adaptation","created":"2025-01-19","cited_by_count":21,"area":null},{"id":"2212.06278","title":"Efficient Bayesian Uncertainty Estimation for nnU-Net","created":"2022-12-12","cited_by_count":19,"area":null},{"id":"2301.11989","title":"Practical Differentially Private Hyperparameter Tuning with Subsampling","created":"2023-01-27","cited_by_count":19,"area":null},{"id":"2302.04228","title":"Federated Learning as Variational Inference: A Scalable Expectation Propagation Approach","created":"2023-02-08","cited_by_count":17,"area":null},{"id":"2201.13011","title":"On the Power-Law Hessian Spectrums in Deep Learning","created":"2022-01-31","cited_by_count":16,"area":null},{"id":"2101.04117","title":"A Bayesian neural network predicts the dissolution of compact planetary systems","created":"2021-01-11","cited_by_count":15,"area":null},{"id":"2101.06640","title":"Estimating informativeness of samples with Smooth Unique Information","created":"2021-01-17","cited_by_count":15,"area":null},{"id":"2109.08248","title":"Assessments of epistemic uncertainty using Gaussian stochastic weight averaging for fluid-flow regression","created":"2021-09-16","cited_by_count":15,"area":null},{"id":"2209.11964","title":"Strong Transferable Adversarial Attacks via Ensembled Asymptotically Normal Distribution Learning","created":"2022-09-24","cited_by_count":15,"area":null},{"id":"2409.02628","title":"(Implicit) Ensembles of Ensembles: Epistemic Uncertainty Collapse in Large Models","created":"2024-09-04","cited_by_count":15,"area":null},{"id":"2510.27486","title":"FedAdamW: A Communication-Efficient Optimizer with Convergence and Generalization Guarantees for Federated Large Models","created":"2025-10-31","cited_by_count":15,"area":null},{"id":"2301.06308","title":"Stability Analysis of Sharpness-Aware Minimization","created":"2023-01-16","cited_by_count":14,"area":null},{"id":"2310.11428","title":"Butterfly Effects of SGD Noise: Error Amplification in Behavior Cloning and Autoregression","created":"2023-10-17","cited_by_count":14,"area":null},{"id":"2509.26544","title":"Bayesian Influence Functions for Hessian-Free Data Attribution","created":"2025-09-30","cited_by_count":14,"area":null},{"id":"2212.02083","title":"On the Overlooked Structure of Stochastic Gradients","created":"2022-12-05","cited_by_count":13,"area":null},{"id":"2107.09028","title":"Structured Stochastic Gradient MCMC","created":"2021-07-19","cited_by_count":12,"area":null},{"id":"2307.07785","title":"The Interpolating Information Criterion for Overparameterized Models","created":"2023-07-15","cited_by_count":12,"area":null},{"id":"2309.10688","title":"On the different regimes of Stochastic Gradient Descent","created":"2023-09-19","cited_by_count":12,"area":null},{"id":"2405.11336","title":"UPAM: Unified Prompt Attack in Text-to-Image Generation Models Against Both Textual Filters and Visual Checkers","created":"2024-05-18","cited_by_count":12,"area":null},{"id":"2207.08435","title":"Robust Simulation-Based Inference in Cosmology with Bayesian Neural Networks","created":"2022-07-18","cited_by_count":11,"area":null},{"id":"2209.03580","title":"Conformal Methods for Quantifying Uncertainty in Spatiotemporal Data: A Survey","created":"2022-09-08","cited_by_count":11,"area":null},{"id":"2211.10691","title":"Two Facets of SDE Under an Information-Theoretic Lens: Generalization of SGD via Training Trajectories and via Terminal States","created":"2022-11-19","cited_by_count":11,"area":null},{"id":"2307.02041","title":"Multimodal Imbalance-Aware Gradient Modulation for Weakly-supervised Audio-Visual Video Parsing","created":"2023-07-05","cited_by_count":11,"area":null},{"id":"2409.20547","title":"Annealing Flow Generative Models Towards Sampling High-Dimensional and Multi-Modal Distributions","created":"2024-09-30","cited_by_count":11,"area":null},{"id":"2102.12357","title":"Wirelessly Powered Federated Edge Learning: Optimal Tradeoffs Between Convergence and Power Transfer","created":"2021-02-24","cited_by_count":10,"area":null},{"id":"2104.04874","title":"SGD Implicitly Regularizes Generalization Error","created":"2021-04-10","cited_by_count":10,"area":null},{"id":"2210.06205","title":"On Divergence Measures for Bayesian Pseudocoresets","created":"2022-10-12","cited_by_count":10,"area":null},{"id":"2502.03210","title":"From Kernels to Features: A Multi-Scale Adaptive Theory of Feature Learning","created":"2025-02-05","cited_by_count":10,"area":null},{"id":"2602.00170","title":"The Blessing of Dimensionality in LLM Fine-tuning: A Variance-Curvature Perspective","created":"2026-01-30","cited_by_count":10,"area":null},{"id":"2604.14108","title":"Momentum Further Constrains Sharpness at the Edge of Stochastic Stability","created":"2026-04-15","cited_by_count":10,"area":null},{"id":"2202.08804","title":"Hybridizing Physical and Data-driven Prediction Methods for Physicochemical Properties","created":"2022-02-17","cited_by_count":9,"area":null},{"id":"2202.09867","title":"Interacting Contour Stochastic Gradient Langevin Dynamics","created":"2022-02-20","cited_by_count":9,"area":null},{"id":"2203.00089","title":"Amortized Proximal Optimization","created":"2022-02-28","cited_by_count":9,"area":null},{"id":"2206.00944","title":"Feature Space Particle Inference for Neural Network Ensembles","created":"2022-06-02","cited_by_count":9,"area":null},{"id":"2209.10715","title":"Batch Bayesian optimisation via density-ratio estimation with guarantees","created":"2022-09-22","cited_by_count":9,"area":null},{"id":"2507.12709","title":"From SGD to Spectra: A Theory of Neural Network Weight Dynamics","created":"2025-07-17","cited_by_count":9,"area":null},{"id":"2107.11774","title":"SGD with a Constant Large Learning Rate Can Converge to Local Maxima","created":"2021-07-25","cited_by_count":8,"area":null},{"id":"2110.05960","title":"Imitating Deep Learning Dynamics via Locally Elastic Stochastic Differential Equations","created":"2021-10-11","cited_by_count":8,"area":null},{"id":"2110.09057","title":"Training Deep Neural Networks with Adaptive Momentum Inspired by the Quadratic Optimization","created":"2021-10-18","cited_by_count":8,"area":null},{"id":"2401.07250","title":"Stabilizing Sharpness-aware Minimization Through A Simple Renormalization Strategy","created":"2024-01-14","cited_by_count":8,"area":null},{"id":"2402.18752","title":"Pre-training Differentially Private Models with Limited Public Data","created":"2024-02-28","cited_by_count":8,"area":null},{"id":"2510.15262","title":"Robust Layerwise Scaling Rules by Proper Weight Decay Tuning","created":"2025-10-17","cited_by_count":8,"area":null},{"id":"2112.03754","title":"A Continuous-time Stochastic Gradient Descent Method for Continuous Data","created":"2021-12-07","cited_by_count":7,"area":null},{"id":"2202.08867","title":"Fast online inference for nonlinear contextual bandit based on Generative Adversarial Network","created":"2022-02-17","cited_by_count":7,"area":null},{"id":"2209.11960","title":"Raising the Bar on the Evaluation of Out-of-Distribution Detection","created":"2022-09-24","cited_by_count":7,"area":null},{"id":"2211.10837","title":"Non-reversible Parallel Tempering for Deep Posterior Approximation","created":"2022-11-20","cited_by_count":7,"area":null},{"id":"2304.02911","title":"Heavy-Tailed Regularization of Weight Matrices in Deep Neural Networks","created":"2023-04-06","cited_by_count":7,"area":null},{"id":"2310.19215","title":"On the accuracy and efficiency of group-wise clipping in differentially private optimization","created":"2023-10-30","cited_by_count":7,"area":null},{"id":"2401.09787","title":"Querying Easily Flip-flopped Samples for Deep Active Learning","created":"2024-01-18","cited_by_count":7,"area":null},{"id":"2405.07839","title":"Constrained Exploration via Reflected Replica Exchange Stochastic Gradient Langevin Dynamics","created":"2024-05-13","cited_by_count":7,"area":null},{"id":"2410.16710","title":"Influential Language Data Selection via Gradient Trajectory Pursuit","created":"2024-10-22","cited_by_count":7,"area":null},{"id":"2602.06500","title":"Can Microcanonical Langevin Dynamics Leverage Mini-Batch Gradient Noise?","created":"2026-02-06","cited_by_count":7,"area":null},{"id":"2606.29554","title":"Optimizer Memory Makes Shuffle Order a First-Order Source of Fine-Tuning Noise","created":"2026-06-28","cited_by_count":7,"area":null},{"id":"2302.02563","title":"Stochastic Gradient Descent-Induced Drift of Representation in a Two-Layer Neural Network","created":"2023-02-06","cited_by_count":6,"area":null},{"id":"2305.07715","title":"Field theory for optimal signal propagation in ResNets","created":"2023-05-12","cited_by_count":6,"area":null},{"id":"2306.09686","title":"Collapsed Inference for Bayesian Deep Learning","created":"2023-06-16","cited_by_count":6,"area":null},{"id":"2112.00987","title":"On Large Batch Training and Sharp Minima: A Fokker-Planck Perspective","created":"2021-12-02","cited_by_count":5,"area":null},{"id":"2209.09162","title":"On the Theoretical Properties of Noise Correlation in Stochastic Optimization","created":"2022-09-19","cited_by_count":5,"area":null},{"id":"2401.00161","title":"DiffHybrid-UQ: Uncertainty Quantification for Differentiable Hybrid Neural Modeling","created":"2023-12-30","cited_by_count":5,"area":null}],"next_cursor":"100"}