{"total":84,"rows":[{"id":"2109.01050","title":"Characterizing possible failure modes in physics-informed neural networks","created":"2021-09-02","cited_by_count":643,"area":null},{"id":"2406.16793","title":"Adam-mini: Use Fewer Learning Rates To Gain More","created":"2024-06-24","cited_by_count":137,"area":null},{"id":"2402.16788","title":"Why Transformers Need Adam: A Hessian Perspective","created":"2024-02-26","cited_by_count":124,"area":null},{"id":"2111.14213","title":"Local Learning Matters: Rethinking Data Heterogeneity in Federated Learning","created":"2021-11-28","cited_by_count":114,"area":null},{"id":"2109.05211","title":"RobustART: Benchmarking Robustness on Architecture Design and Training Techniques","created":"2021-09-11","cited_by_count":79,"area":null},{"id":"2104.04448","title":"Relating Adversarially Robust Generalization to Flat Minima","created":"2021-04-09","cited_by_count":57,"area":null},{"id":"2303.03108","title":"Gradient Norm Aware Minimization Seeks First-Order Flatness and Improves Generalization","created":"2023-03-03","cited_by_count":57,"area":null},{"id":"2202.08187","title":"Differential Privacy and Fairness in Decisions and Learning Tasks: A Survey","created":"2022-02-16","cited_by_count":47,"area":null},{"id":"2102.04877","title":"Noisy Recurrent Neural Networks","created":"2021-02-09","cited_by_count":42,"area":null},{"id":"2210.06443","title":"On the Effectiveness of Lipschitz-Driven Rehearsal in Continual Learning","created":"2022-10-12","cited_by_count":39,"area":null},{"id":"2107.11228","title":"Taxonomizing local versus global structure in neural network loss landscapes","created":"2021-07-23","cited_by_count":34,"area":null},{"id":"2103.01519","title":"Hessian Eigenspectra of More Realistic Nonlinear Models","created":"2021-03-02","cited_by_count":33,"area":null},{"id":"2106.13897","title":"Implicit Gradient Alignment in Distributed and Federated Learning","created":"2021-06-25","cited_by_count":29,"area":null},{"id":"2107.05802","title":"How many degrees of freedom do we need to train deep networks: a loss landscape perspective","created":"2021-07-13","cited_by_count":28,"area":null},{"id":"2303.10653","title":"Randomized Adversarial Training via Taylor Expansion","created":"2023-03-19","cited_by_count":28,"area":null},{"id":"2307.11108","title":"Flatness-Aware Minimization for Domain Generalization","created":"2023-07-20","cited_by_count":27,"area":null},{"id":"2103.00543","title":"On the Utility of Gradient Compression in Distributed Training Systems","created":"2021-02-28","cited_by_count":26,"area":null},{"id":"2212.04985","title":"Understanding and Combating Robust Overfitting via Input Loss Landscape Analysis and Regularization","created":"2022-12-09","cited_by_count":22,"area":null},{"id":"2101.04968","title":"Learning with Gradient Descent and Weakly Convex Losses","created":"2021-01-13","cited_by_count":16,"area":null},{"id":"2107.10370","title":"Analytic Study of Families of Spurious Minima in Two-Layer ReLU Neural Networks: A Tale of Symmetry II","created":"2021-07-21","cited_by_count":16,"area":null},{"id":"2201.13011","title":"On the Power-Law Hessian Spectrums in Deep Learning","created":"2022-01-31","cited_by_count":16,"area":null},{"id":"2208.13219","title":"Visualizing high-dimensional loss landscapes with Hessian directions","created":"2022-08-28","cited_by_count":16,"area":null},{"id":"2104.07639","title":"Robust Optimization for Multilingual Translation with Imbalanced Data","created":"2021-04-15","cited_by_count":15,"area":null},{"id":"2202.10226","title":"Approximate Nearest Neighbor Search under Neural Similarity Metric for Large-Scale Recommendation","created":"2022-02-14","cited_by_count":14,"area":null},{"id":"2401.12033","title":"Momentum-SAM: Sharpness Aware Minimization without Computational Overhead","created":"2024-01-22","cited_by_count":14,"area":null},{"id":"2103.06219","title":"Why flatness does and does not correlate with generalization for deep neural networks","created":"2021-03-10","cited_by_count":13,"area":null},{"id":"2212.02083","title":"On the Overlooked Structure of Stochastic Gradients","created":"2022-12-05","cited_by_count":13,"area":null},{"id":"2305.15659","title":"How to escape sharp minima with random perturbations","created":"2023-05-25","cited_by_count":13,"area":null},{"id":"2505.02809","title":"Towards Quantifying the Hessian Structure of Neural Networks","created":"2025-05-05","cited_by_count":13,"area":null},{"id":"2307.07785","title":"The Interpolating Information Criterion for Overparameterized Models","created":"2023-07-15","cited_by_count":12,"area":null},{"id":"2106.00221","title":"Concurrent Adversarial Learning for Large-Batch Training","created":"2021-06-01","cited_by_count":11,"area":null},{"id":"2404.06106","title":"Unifying Low Dimensional Spectra in Deep Learning","created":"2024-04-09","cited_by_count":11,"area":null},{"id":"2205.07320","title":"Analyzing Lottery Ticket Hypothesis from PAC-Bayesian Theory Perspective","created":"2022-05-15","cited_by_count":9,"area":null},{"id":"2106.03091","title":"Regularization in ResNet with Stochastic Depth","created":"2021-06-06","cited_by_count":7,"area":null},{"id":"2303.15634","title":"Learning Rate Schedules in the Presence of Distribution Shift","created":"2023-03-27","cited_by_count":7,"area":null},{"id":"2105.06369","title":"Neighborhood-Aware Neural Architecture Search","created":"2021-05-13","cited_by_count":6,"area":null},{"id":"2201.09209","title":"Weight Expansion: A New Perspective on Dropout and Generalization","created":"2022-01-23","cited_by_count":6,"area":null},{"id":"2112.08916","title":"GOSH: Task Scheduling Using Deep Surrogate Models in Fog Computing Environments","created":"2021-12-16","cited_by_count":5,"area":null},{"id":"2211.11835","title":"Fairness Increases Adversarial Vulnerability","created":"2022-11-21","cited_by_count":5,"area":null},{"id":"2311.07013","title":"A PAC-Bayesian Perspective on the Interpolating Information Criterion","created":"2023-11-13","cited_by_count":5,"area":null},{"id":"2411.02139","title":"Theoretical characterisation of the Gauss-Newton conditioning in Neural Networks","created":"2024-11-04","cited_by_count":5,"area":null},{"id":"2106.12612","title":"Minimum sharpness: Scale-invariant parameter-robustness of neural networks","created":"2021-06-23","cited_by_count":4,"area":null},{"id":"2405.19915","title":"P$^2$-ViT: Power-of-Two Post-Training Quantization and Acceleration for Fully Quantized Vision Transformer","created":"2024-05-30","cited_by_count":4,"area":null},{"id":"2410.13605","title":"Transformer-Based Approaches for Sensor-Based Human Activity Recognition: Opportunities and Challenges","created":"2024-10-17","cited_by_count":4,"area":null},{"id":"2508.17232","title":"Curvature Learning for Generalization of Hyperbolic Neural Networks","created":"2025-08-24","cited_by_count":4,"area":null},{"id":"2206.00823","title":"Beyond accuracy: generalization properties of bio-plausible temporal credit assignment rules","created":"2022-06-02","cited_by_count":3,"area":null},{"id":"2210.12184","title":"A New Perspective for Understanding Generalization Gap of Deep Neural Networks Trained with Large Batch Sizes","created":"2022-10-21","cited_by_count":3,"area":null},{"id":"2406.16988","title":"MD tree: a model-diagnostic tree grown on loss landscape","created":"2024-06-24","cited_by_count":3,"area":null},{"id":"2406.20006","title":"On the Trade-off between Flatness and Optimization in Distributed Learning","created":"2024-06-28","cited_by_count":3,"area":null},{"id":"2407.12996","title":"Sharpness-diversity tradeoff: improving flat ensembles with SharpBalance","created":"2024-07-17","cited_by_count":3,"area":null},{"id":"2408.04065","title":"Do Sharpness-based Optimizers Improve Generalization in Medical Image Analysis?","created":"2024-08-07","cited_by_count":3,"area":null},{"id":"2501.14414","title":"SoK: What Makes Private Learning Unfair?","created":"2025-01-24","cited_by_count":3,"area":null},{"id":"2504.10231","title":"A Model Zoo of Vision Transformers","created":"2025-04-14","cited_by_count":3,"area":null},{"id":"2504.18072","title":"A Model Zoo on Phase Transitions in Neural Networks","created":"2025-04-25","cited_by_count":3,"area":null},{"id":"2605.17471","title":"WinQ: Accelerating Quantization-Aware Training of Language Models Around Saddle Points","created":"2026-05-17","cited_by_count":3,"area":null},{"id":"2207.01847","title":"PoF: Post-Training of Feature Extractor for Improving Generalization","created":"2022-07-05","cited_by_count":2,"area":null},{"id":"2307.02337","title":"FAM: Relative Flatness Aware Minimization","created":"2023-07-05","cited_by_count":2,"area":null},{"id":"2412.13321","title":"LossLens: Diagnostics for Machine Learning through Loss Landscape Visual Analytics","created":"2024-12-17","cited_by_count":2,"area":null},{"id":"2505.11491","title":"Potential failures of physics-informed machine learning in traffic flow modeling: theoretical and experimental analysis","created":"2025-05-16","cited_by_count":2,"area":null},{"id":"2506.07871","title":"Can Hessian-Based Insights Support Fault Diagnosis in Attention-based Models?","created":"2025-06-09","cited_by_count":2,"area":null},{"id":"2604.19740","title":"Generalization at the Edge of Stability","created":"2026-04-21","cited_by_count":2,"area":null},{"id":"2102.11210","title":"Non-Convex Optimization with Spectral Radius Regularization","created":"2021-02-22","cited_by_count":1,"area":null},{"id":"2105.02062","title":"Understanding Short-Range Memory Effects in Deep Neural Networks","created":"2021-05-05","cited_by_count":1,"area":null},{"id":"2204.01365","title":"Deep learning, stochastic gradient descent and diffusion maps","created":"2022-04-04","cited_by_count":1,"area":null},{"id":"2207.03400","title":"On the Relationship Between Adversarial Robustness and Decision Region in Deep Neural Networks","created":"2022-07-07","cited_by_count":1,"area":null},{"id":"2311.02818","title":"Signal Processing Meets SGD: From Momentum to Filter","created":"2023-11-06","cited_by_count":1,"area":null},{"id":"2311.13169","title":"SiGeo: Sub-One-Shot NAS via Information Theory and Geometry of Loss Landscape","created":"2023-11-22","cited_by_count":1,"area":null},{"id":"2502.04889","title":"Any-stepsize Gradient Descent for Separable Data under Fenchel-Young Losses","created":"2025-02-07","cited_by_count":1,"area":null},{"id":"2505.20892","title":"One-Time Soft Alignment Enables Resilient Learning without Weight Transport","created":"2025-05-27","cited_by_count":1,"area":null},{"id":"2507.07883","title":"SAMO: A Lightweight Sharpness-Aware Approach for Multi-Task Optimization with Joint Global-Local Perturbation","created":"2025-07-10","cited_by_count":1,"area":null},{"id":"2508.18860","title":"C-Flat++: Towards a More Efficient and Powerful Framework for Continual Learning","created":"2025-08-26","cited_by_count":1,"area":null},{"id":"2603.06120","title":"Dynamic Momentum Recalibration in Online Gradient Learning","created":"2026-03-06","cited_by_count":1,"area":null},{"id":"2606.30226","title":"Characterizing Optimizer-Dependent Training Dynamics Through Hessian Eigenvector Displacement and Localization","created":"2026-06-29","cited_by_count":1,"area":null},{"id":"2201.12469","title":"ScaLA: Accelerating Adaptation of Pre-Trained Transformer-Based Language Models via Efficient Large-Batch Adversarial Noise","created":"2022-01-29","cited_by_count":0,"area":null},{"id":"2310.01165","title":"Towards guarantees for parameter isolation in continual learning","created":"2023-10-02","cited_by_count":0,"area":null},{"id":"2310.18741","title":"On Training Implicit Meta-Learning With Applications to Inductive Weighing in Consistency Regularization","created":"2023-10-28","cited_by_count":0,"area":null},{"id":"2403.16405","title":"Ensemble Adversarial Defense via Integration of Multiple Dispersed Low Curvature Models","created":"2024-03-25","cited_by_count":0,"area":null},{"id":"2407.11037","title":"ISQuant: apply squant to the real deployment","created":"2024-07-05","cited_by_count":0,"area":null},{"id":"2502.21041","title":"Fast Adversarial Training against Sparse Attacks Requires Loss Smoothing","created":"2025-02-28","cited_by_count":0,"area":null},{"id":"2509.10537","title":"On Using Large-Batches in Federated Learning","created":"2025-09-05","cited_by_count":0,"area":null},{"id":"2510.27651","title":"Information-Theoretic Greedy Layer-wise Training for Traffic Sign Recognition","created":"2025-10-31","cited_by_count":0,"area":null},{"id":"2602.21276","title":"Neural network optimization strategies and the topography of the loss landscape","created":"2026-02-24","cited_by_count":0,"area":null},{"id":"2603.18112","title":"Tula: Optimizing Time, Cost, and Generalization in Distributed Large-Batch Training","created":"2026-03-18","cited_by_count":0,"area":null},{"id":"2607.07845","title":"Explaining Near-Zero Hessian Eigenvalues Through Approximate Symmetries in Neural Networks","created":"2026-07-08","cited_by_count":0,"area":null}],"next_cursor":null}