{"total":43,"rows":[{"id":"2109.02934","title":"Fishr: Invariant Gradient Variances for Out-of-Distribution Generalization","created":"2021-09-07","cited_by_count":186,"area":null},{"id":"2107.03356","title":"M-FAC: Efficient Matrix-Free Approximations of Second-Order Information","created":"2021-07-07","cited_by_count":54,"area":null},{"id":"2302.14623","title":"Fast as CHITA: Neural Network Pruning with Combinatorial Optimization","created":"2023-02-28","cited_by_count":40,"area":null},{"id":"2102.05375","title":"Strength of Minibatch Noise in SGD","created":"2021-02-10","cited_by_count":39,"area":null},{"id":"2106.00734","title":"Post-mortem on a deep learning contest: a Simpson's paradox and the complementary roles of scale metrics versus shape metrics","created":"2021-06-01","cited_by_count":19,"area":null},{"id":"2107.09133","title":"The Limiting Dynamics of SGD: Modified Loss, Phase Space Oscillations, and Anomalous Diffusion","created":"2021-07-19","cited_by_count":19,"area":null},{"id":"2209.03695","title":"Training Scale-Invariant Neural Networks on the Sphere Can Happen in Three Regimes","created":"2022-09-08","cited_by_count":19,"area":null},{"id":"2503.18595","title":"Adaptive Unimodal Regulation for Balanced Multimodal Information Acquisition","created":"2025-03-24","cited_by_count":19,"area":null},{"id":"2205.04878","title":"Hybrid quantum ResNet for car classification and its hyperparameter optimization","created":"2022-05-10","cited_by_count":17,"area":null},{"id":"2106.02624","title":"ViViT: Curvature access through the generalized Gauss-Newton's low-rank structure","created":"2021-06-04","cited_by_count":16,"area":null},{"id":"2201.13011","title":"On the Power-Law Hessian Spectrums in Deep Learning","created":"2022-01-31","cited_by_count":16,"area":null},{"id":"2104.07639","title":"Robust Optimization for Multilingual Translation with Imbalanced Data","created":"2021-04-15","cited_by_count":15,"area":null},{"id":"2406.06420","title":"An Improved Empirical Fisher Approximation for Natural Gradient Descent","created":"2024-06-10","cited_by_count":15,"area":null},{"id":"2507.18807","title":"Fishers for Free? Approximating the Fisher Information Matrix by Recycling the Squared Gradient Accumulator","created":"2025-07-24","cited_by_count":14,"area":null},{"id":"2211.10691","title":"Two Facets of SDE Under an Information-Theoretic Lens: Generalization of SGD via Training Trajectories and via Terminal States","created":"2022-11-19","cited_by_count":11,"area":null},{"id":"2301.12309","title":"On the Lipschitz Constant of Deep Networks and Double Descent","created":"2023-01-28","cited_by_count":11,"area":null},{"id":"2310.00692","title":"A Theoretical Analysis of Noise Geometry in Stochastic Gradient Descent","created":"2023-10-01","cited_by_count":9,"area":null},{"id":"2202.04124","title":"A Mini-Block Fisher Method for Deep Neural Networks","created":"2022-02-08","cited_by_count":8,"area":null},{"id":"2102.06604","title":"Cockpit: A Practical Debugging Tool for the Training of Deep Neural Networks","created":"2021-02-12","cited_by_count":7,"area":null},{"id":"2206.15143","title":"Scalable K-FAC Training for Deep Neural Networks with Distributed Preconditioning","created":"2022-06-30","cited_by_count":7,"area":null},{"id":"2107.06533","title":"Accelerating Distributed K-FAC with Smart Parallelism of Computing and Communication Tasks","created":"2021-07-14","cited_by_count":5,"area":null},{"id":"2306.10081","title":"Optimizer's Information Criterion: Dissecting and Correcting Bias in Data-Driven Optimization","created":"2023-06-16","cited_by_count":4,"area":null},{"id":"2206.00823","title":"Beyond accuracy: generalization properties of bio-plausible temporal credit assignment rules","created":"2022-06-02","cited_by_count":3,"area":null},{"id":"2107.04695","title":"L2M: Practical posterior Laplace approximation with optimization-driven second moment estimation","created":"2021-07-09","cited_by_count":2,"area":null},{"id":"2112.03660","title":"A generalization gap estimation for overparameterized models via the Langevin functional variance","created":"2021-12-07","cited_by_count":2,"area":null},{"id":"2206.12832","title":"Prediction Errors for Penalized Regressions based on Generalized Approximate Message Passing","created":"2022-06-26","cited_by_count":2,"area":null},{"id":"2210.13599","title":"Noise Injection as a Probe of Deep Learning Dynamics","created":"2022-10-24","cited_by_count":2,"area":null},{"id":"2306.05300","title":"Anti-Correlated Noise in Epoch-Based Stochastic Gradient Descent: Implications for Weight Variances in Flat Directions","created":"2023-06-08","cited_by_count":2,"area":null},{"id":"2307.14823","title":"Fading memory as inductive bias in residual recurrent networks","created":"2023-07-27","cited_by_count":2,"area":null},{"id":"2310.04649","title":"Uncovering Model Processing Strategies with Non-Negative Per-Example Fisher Factorization","created":"2023-10-07","cited_by_count":2,"area":null},{"id":"2311.13169","title":"SiGeo: Sub-One-Shot NAS via Information Theory and Geometry of Loss Landscape","created":"2023-11-22","cited_by_count":1,"area":null},{"id":"2311.14120","title":"Weight fluctuations in (deep) linear neural networks and a derivation of the inverse-variance flatness relation","created":"2023-11-23","cited_by_count":1,"area":null},{"id":"2404.19725","title":"CurvFed: Curvature-Aligned Federated Learning for Fairness without Demographics","created":"2024-04-30","cited_by_count":1,"area":null},{"id":"2506.17809","title":"Flatness After All?","created":"2025-06-21","cited_by_count":1,"area":null},{"id":"2601.18420","title":"Gradient Regularized Natural Gradients","created":"2026-01-26","cited_by_count":1,"area":null},{"id":"2603.13373","title":"Ethical Fairness in Ubiquitous Health Sensing without Known Attributes","created":"2026-03-10","cited_by_count":1,"area":null},{"id":"2607.23012","title":"Mini-batch Noise Lowers Sharpness via Dominant-Subspace Fluctuations","created":"2026-07-25","cited_by_count":1,"area":null},{"id":"2212.06566","title":"How to select an objective function using information theory","created":"2022-12-10","cited_by_count":0,"area":null},{"id":"2512.07676","title":"A Bootstrap Perspective on Stochastic Gradient Descent","created":"2025-12-08","cited_by_count":0,"area":null},{"id":"2512.11089","title":"TPV: Parameter Perturbations Through the Lens of Test Prediction Variance","created":"2025-12-11","cited_by_count":0,"area":null},{"id":"2602.23219","title":"Takeuchi's Information Criteria as Generalization Measures for DNNs Close to NTK Regime","created":"2026-02-26","cited_by_count":0,"area":null},{"id":"2603.11989","title":"On-Average Stability of Multipass Preconditioned SGD and Effective Dimension","created":"2026-03-12","cited_by_count":0,"area":null},{"id":"2606.00542","title":"Rethinking Bregman Divergences in Kronecker-Factored Optimizers","created":"2026-05-30","cited_by_count":0,"area":null}],"next_cursor":null}