{"total":83,"rows":[{"id":"2205.09745","title":"Understanding Gradient Descent on Edge of Stability in Deep Learning","created":"2022-05-19","cited_by_count":128,"area":null},{"id":"2206.04041","title":"Neural Collapse: A Review on Modelling Principles and Generalization","created":"2022-06-08","cited_by_count":95,"area":null},{"id":"2303.09105","title":"Rethinking Model Ensemble in Transfer-based Adversarial Attacks","created":"2023-03-16","cited_by_count":89,"area":null},{"id":"2206.07085","title":"Understanding the Generalization Benefit of Normalization Layers: Sharpness Reduction","created":"2022-06-14","cited_by_count":86,"area":null},{"id":"2207.02628","title":"The alignment property of SGD noise and how it helps select flat minima: A stability analysis","created":"2022-07-06","cited_by_count":64,"area":null},{"id":"2105.13462","title":"On Linear Stability of SGD and Input-Smoothness of Neural Networks","created":"2021-05-27","cited_by_count":63,"area":null},{"id":"2109.14119","title":"Stochastic Training is Not Necessary for Generalization","created":"2021-09-29","cited_by_count":63,"area":null},{"id":"2110.03095","title":"Which Shortcut Cues Will DNNs Choose? A Study from the Parameter-Space Perspective","created":"2021-10-06","cited_by_count":57,"area":null},{"id":"2402.11867","title":"LoRA Training in the NTK Regime has No Spurious Local Minima","created":"2024-02-19","cited_by_count":48,"area":null},{"id":"2305.17490","title":"The Implicit Regularization of Dynamical Stability in Stochastic Gradient Descent","created":"2023-05-27","cited_by_count":44,"area":null},{"id":"2105.14573","title":"Embedding Principle of Loss Landscape of Deep Neural Networks","created":"2021-05-30","cited_by_count":38,"area":null},{"id":"2210.17216","title":"Symmetries, flat minima, and the conserved quantities of gradient flow","created":"2022-10-31","cited_by_count":35,"area":null},{"id":"2106.02105","title":"A Little Robustness Goes a Long Way: Leveraging Robust Features for Targeted Transfer Attacks","created":"2021-06-03","cited_by_count":34,"area":null},{"id":"2306.04815","title":"Catapults in SGD: spikes in the training loss and their impact on generalization through feature learning","created":"2023-06-07","cited_by_count":31,"area":null},{"id":"2206.08684","title":"Sparse Double Descent: Where Network Pruning Aggravates Overfitting","created":"2022-06-17","cited_by_count":26,"area":null},{"id":"2406.04112","title":"Compressible Dynamics in Deep Overparameterized Low-Rank Learning & Adaptation","created":"2024-06-06","cited_by_count":26,"area":null},{"id":"2305.13404","title":"Improving Convergence and Generalization Using Parameter Symmetries","created":"2023-05-22","cited_by_count":23,"area":null},{"id":"2308.02533","title":"Improving Generalization of Adversarial Training via Robust Critical Fine-Tuning","created":"2023-08-01","cited_by_count":23,"area":null},{"id":"2111.15527","title":"Embedding Principle: a hierarchical structure of loss landscape of deep neural networks","created":"2021-11-30","cited_by_count":22,"area":null},{"id":"2307.01998","title":"Zero-Shot Neural Architecture Search: Challenges, Solutions, and Opportunities","created":"2023-07-05","cited_by_count":21,"area":null},{"id":"2205.12694","title":"Train Flat, Then Compress: Sharpness-Aware Minimization Learns More Compressible Models","created":"2022-05-25","cited_by_count":20,"area":null},{"id":"2110.11749","title":"Feature Learning and Signal Propagation in Deep Neural Networks","created":"2021-10-22","cited_by_count":18,"area":null},{"id":"2306.14306","title":"Adaptive Sharpness-Aware Pruning for Robust Sparse Networks","created":"2023-06-25","cited_by_count":17,"area":null},{"id":"2107.10370","title":"Analytic Study of Families of Spurious Minima in Two-Layer ReLU Neural Networks: A Tale of Symmetry II","created":"2021-07-21","cited_by_count":16,"area":null},{"id":"2201.13011","title":"On the Power-Law Hessian Spectrums in Deep Learning","created":"2022-01-31","cited_by_count":16,"area":null},{"id":"2305.12133","title":"Loss Spike in Training Neural Networks","created":"2023-05-20","cited_by_count":16,"area":null},{"id":"2405.20763","title":"Improving Generalization and Convergence by Enhancing Implicit Regularization","created":"2024-05-31","cited_by_count":14,"area":null},{"id":"2103.06219","title":"Why flatness does and does not correlate with generalization for deep neural networks","created":"2021-03-10","cited_by_count":13,"area":null},{"id":"2212.02083","title":"On the Overlooked Structure of Stochastic Gradients","created":"2022-12-05","cited_by_count":13,"area":null},{"id":"2505.02809","title":"Towards Quantifying the Hessian Structure of Neural Networks","created":"2025-05-05","cited_by_count":13,"area":null},{"id":"2309.10688","title":"On the different regimes of Stochastic Gradient Descent","created":"2023-09-19","cited_by_count":12,"area":null},{"id":"2105.03906","title":"TextAdaIN: Paying Attention to Shortcut Learning in Text Recognizers","created":"2021-05-09","cited_by_count":11,"area":null},{"id":"2306.07850","title":"Exact Mean Square Linear Stability Analysis for SGD","created":"2023-06-13","cited_by_count":11,"area":null},{"id":"2404.06106","title":"Unifying Low Dimensional Spectra in Deep Learning","created":"2024-04-09","cited_by_count":11,"area":null},{"id":"2206.09313","title":"Laziness, Barren Plateau, and Noise in Machine Learning","created":"2022-06-19","cited_by_count":10,"area":null},{"id":"2404.03176","title":"Information-Theoretic Generalization Bounds for Deep Neural Networks","created":"2024-04-04","cited_by_count":10,"area":null},{"id":"2201.04738","title":"Implicit Bias of MSE Gradient Optimization in Underparameterized Neural Networks","created":"2022-01-12","cited_by_count":9,"area":null},{"id":"2310.00692","title":"A Theoretical Analysis of Noise Geometry in Stochastic Gradient Descent","created":"2023-10-01","cited_by_count":9,"area":null},{"id":"2404.06391","title":"Exploring Neural Network Landscapes: Star-Shaped and Geodesic Connectivity","created":"2024-04-09","cited_by_count":9,"area":null},{"id":"2107.11774","title":"SGD with a Constant Large Learning Rate Can Converge to Local Maxima","created":"2021-07-25","cited_by_count":8,"area":null},{"id":"2102.05110","title":"Adversarial Perturbations Are Not So Weird: Entanglement of Robust and Non-Robust Features in Neural Network Classifiers","created":"2021-02-09","cited_by_count":7,"area":null},{"id":"2205.13283","title":"Embedding Principle in Depth for the Loss Landscape Analysis of Deep Neural Networks","created":"2022-05-26","cited_by_count":7,"area":null},{"id":"2111.04004","title":"Exponential escape efficiency of SGD from sharp minima in non-stationary regime","created":"2021-11-07","cited_by_count":5,"area":null},{"id":"2112.00987","title":"On Large Batch Training and Sharp Minima: A Fokker-Planck Perspective","created":"2021-12-02","cited_by_count":5,"area":null},{"id":"2205.03940","title":"Investigating Generalization by Controlling Normalized Margin","created":"2022-05-08","cited_by_count":5,"area":null},{"id":"2306.07104","title":"Unveiling the Hessian's Connection to the Decision Boundary","created":"2023-06-12","cited_by_count":5,"area":null},{"id":"2410.10589","title":"MoTE: Reconciling Generalization with Specialization for Visual-Language to Video Knowledge Transfer","created":"2024-10-14","cited_by_count":5,"area":null},{"id":"2106.10704","title":"Better Training using Weight-Constrained Stochastic Dynamics","created":"2021-06-20","cited_by_count":4,"area":null},{"id":"2106.12612","title":"Minimum sharpness: Scale-invariant parameter-robustness of neural networks","created":"2021-06-23","cited_by_count":4,"area":null},{"id":"2209.15265","title":"Overparameterized ReLU Neural Networks Learn the Simplest Models: Neural Isometry and Exact Recovery","created":"2022-09-30","cited_by_count":3,"area":null},{"id":"2310.10006","title":"Soft ascent-descent as a stable and flexible alternative to flooding","created":"2023-10-16","cited_by_count":3,"area":null},{"id":"2407.16556","title":"DC is all you need: describing ReLU from a signal processing standpoint","created":"2024-07-23","cited_by_count":3,"area":null},{"id":"2105.09934","title":"Probing the Effect of Selection Bias on Generalization: A Thought Experiment","created":"2021-05-20","cited_by_count":2,"area":null},{"id":"2111.03940","title":"Convolutional Gated MLP: Combining Convolutions & gMLP","created":"2021-11-06","cited_by_count":2,"area":null},{"id":"2207.01847","title":"PoF: Post-Training of Feature Extractor for Improving Generalization","created":"2022-07-05","cited_by_count":2,"area":null},{"id":"2211.09639","title":"Why Deep Learning Generalizes","created":"2022-11-17","cited_by_count":2,"area":null},{"id":"2401.12332","title":"A Precise Characterization of SGD Stability Using Loss Surface Geometry","created":"2024-01-22","cited_by_count":2,"area":null},{"id":"2406.17246","title":"Beyond Silence: Bias Analysis through Loss and Asymmetric Approach in Audio Anti-Spoofing","created":"2024-06-25","cited_by_count":2,"area":null},{"id":"2503.06001","title":"Analyzing the Role of Permutation Invariance in Linear Mode Connectivity","created":"2025-03-08","cited_by_count":2,"area":null},{"id":"2602.05600","title":"On the Superlinear Relationship between SGD Noise Covariance and Loss Landscape Curvature","created":"2026-02-05","cited_by_count":2,"area":null},{"id":"2204.01365","title":"Deep learning, stochastic gradient descent and diffusion maps","created":"2022-04-04","cited_by_count":1,"area":null},{"id":"2212.04938","title":"Emergent Computations in Trained Artificial Neural Networks and Real Brains","created":"2022-12-09","cited_by_count":1,"area":null},{"id":"2310.07560","title":"ROMO: Retrieval-enhanced Offline Model-based Optimization","created":"2023-10-11","cited_by_count":1,"area":null},{"id":"2311.13169","title":"SiGeo: Sub-One-Shot NAS via Information Theory and Geometry of Loss Landscape","created":"2023-11-22","cited_by_count":1,"area":null},{"id":"2601.18420","title":"Gradient Regularized Natural Gradients","created":"2026-01-26","cited_by_count":1,"area":null},{"id":"2606.17660","title":"TuneAhead: Predicting Fine-tuning Performance Before Full Training Begins","created":"2026-06-16","cited_by_count":1,"area":null},{"id":"2107.01525","title":"AdaL: Adaptive Gradient Transformation Contributes to Convergences and Generalizations","created":"2021-07-04","cited_by_count":0,"area":null},{"id":"2202.06163","title":"Evolving Neural Networks with Optimal Balance between Information Flow and Connections Cost","created":"2022-02-12","cited_by_count":0,"area":null},{"id":"2210.13741","title":"Deep Neural Networks as the Semi-classical Limit of Topological Quantum Neural Networks: The problem of generalisation","created":"2022-10-25","cited_by_count":0,"area":null},{"id":"2305.04526","title":"CrAFT: Compression-Aware Fine-Tuning for Efficient Visual Task Adaptation","created":"2023-05-08","cited_by_count":0,"area":null},{"id":"2305.10748","title":"Physics Inspired Approaches To Understanding Gaussian Processes","created":"2023-05-18","cited_by_count":0,"area":null},{"id":"2312.05759","title":"Beyond One Model Fits All: Ensemble Deep Learning for Autonomous Vehicles","created":"2023-12-10","cited_by_count":0,"area":null},{"id":"2312.14681","title":"Engineered Ordinary Differential Equations as Classification Algorithm (EODECA): thorough characterization and testing","created":"2023-12-22","cited_by_count":0,"area":null},{"id":"2402.14878","title":"Estimation of Energy-dissipation Lower-bounds for Neuromorphic Learning-in-memory","created":"2024-02-21","cited_by_count":0,"area":null},{"id":"2403.15022","title":"Insights into the Lottery Ticket Hypothesis and Iterative Magnitude Pruning","created":"2024-03-22","cited_by_count":0,"area":null},{"id":"2502.11071","title":"Generalization of the Gibbs algorithm with high probability at low temperatures","created":"2025-02-16","cited_by_count":0,"area":null},{"id":"2509.20334","title":"Feature Dynamics as Implicit Data Augmentation: A Depth-Decomposed View on Deep Neural Network Generalization","created":"2025-09-24","cited_by_count":0,"area":null},{"id":"2603.11503","title":"Sharpness-Aware Minimization for Generalized Embedding Learning in Federated Recommendation","created":"2026-03-12","cited_by_count":0,"area":null},{"id":"2605.07914","title":"Flatness and Gradient Alignment Are Both Necessary: Spectral-Aware Gradient-Aligned Exploration for Multi-Distribution Learning","created":"2026-05-08","cited_by_count":0,"area":null},{"id":"2606.04212","title":"Edge of Stability Selectively Shapes Learning Across the Data Distribution","created":"2026-06-02","cited_by_count":0,"area":null},{"id":"2606.25087","title":"Neural Network Quantization by Learning Low-Loss Subspaces","created":"2026-06-23","cited_by_count":0,"area":null},{"id":"2606.30384","title":"Scalar Representations of Neural Network Training Dynamics","created":"2026-06-29","cited_by_count":0,"area":null},{"id":"2607.14233","title":"LIGO-PINN: Learned Initialization via Gated Optimization to Alleviate Convergence Failures in Physics Informed Neural Networks","created":"2026-07-15","cited_by_count":0,"area":null}],"next_cursor":null}