{"total":30,"rows":[{"id":"2102.05262","title":"Input Similarity from the Neural Network Perspective","created":"2021-02-10","cited_by_count":79,"area":null},{"id":"2105.02716","title":"Noether's Learning Dynamics: Role of Symmetry Breaking in Neural Networks","created":"2021-05-06","cited_by_count":50,"area":null},{"id":"2201.12250","title":"Gradient Descent on Neurons and its Link to Approximate Second-Order Optimization","created":"2022-01-28","cited_by_count":30,"area":null},{"id":"2107.04205","title":"On the Variance of the Fisher Information for Deep Learning","created":"2021-07-09","cited_by_count":22,"area":null},{"id":"2305.04684","title":"ASDL: A Unified Interface for Gradient Preconditioning in PyTorch","created":"2023-05-08","cited_by_count":21,"area":null},{"id":"2102.06862","title":"Wasserstein Proximal of GANs","created":"2021-02-13","cited_by_count":15,"area":null},{"id":"2206.15273","title":"Invariance Properties of the Natural Gradient in Overparametrised Systems","created":"2022-06-30","cited_by_count":11,"area":null},{"id":"2302.01952","title":"On a continuous time model of gradient descent dynamics and instability in deep learning","created":"2023-02-03","cited_by_count":11,"area":null},{"id":"2402.05379","title":"Trade-Offs of Diagonal Fisher Information Matrix Estimators","created":"2024-02-08","cited_by_count":10,"area":null},{"id":"2201.10285","title":"Efficient Approximations of the Fisher Matrix in Neural Networks using Kronecker Product Singular Value Decomposition","created":"2022-01-25","cited_by_count":9,"area":null},{"id":"2202.04124","title":"A Mini-Block Fisher Method for Deep Neural Networks","created":"2022-02-08","cited_by_count":8,"area":null},{"id":"2410.15143","title":"Budgeted Online Continual Learning by Adaptive Layer Freezing and Frequency-based Sampling","created":"2024-10-19","cited_by_count":7,"area":null},{"id":"2412.10782","title":"ANaGRAM: A Natural Gradient Relative to Adapted Model for efficient PINNs learning","created":"2024-12-14","cited_by_count":7,"area":null},{"id":"2305.00604","title":"ISAAC Newton: Input-based Approximate Curvature for Newton's Method","created":"2023-05-01","cited_by_count":6,"area":null},{"id":"2410.00131","title":"Fisher Information-based Efficient Curriculum Federated Learning with Large Language Models","created":"2024-09-30","cited_by_count":6,"area":null},{"id":"2212.14776","title":"On the Interpretability of Attention Networks","created":"2022-12-30","cited_by_count":5,"area":null},{"id":"2202.06232","title":"Generalized Tangent Kernel: A Unified Geometric Foundation for Natural Gradient and Standard Gradient","created":"2022-02-13","cited_by_count":2,"area":null},{"id":"2206.10936","title":"Information Geometry of Dropout Training","created":"2022-06-22","cited_by_count":2,"area":null},{"id":"2606.18306","title":"Fisher Width: A Geometric Measure of Complexity on Statistical Manifolds","created":"2026-06-16","cited_by_count":2,"area":null},{"id":"2110.13581","title":"Gradient representations in ReLU networks as similarity functions","created":"2021-10-26","cited_by_count":1,"area":null},{"id":"2307.11249","title":"On the Natural Gradient of the Evidence Lower Bound","created":"2023-07-20","cited_by_count":1,"area":null},{"id":"2312.03885","title":"Gathering and Exploiting Higher-Order Information when Training Large Structured Models","created":"2023-12-06","cited_by_count":1,"area":null},{"id":"2605.17180","title":"The Geometry of Projection Heads: Conditioning, Invariance, and Collapse","created":"2026-05-16","cited_by_count":1,"area":null},{"id":"2606.06418","title":"Double Preconditioning (DoPr): Optimization for Test-Time Performance, not Validation Loss","created":"2026-06-04","cited_by_count":1,"area":null},{"id":"2210.05268","title":"Component-Wise Natural Gradient Descent -- An Efficient Neural Network Optimization","created":"2022-10-11","cited_by_count":0,"area":null},{"id":"2303.18083","title":"Analysis and Comparison of Two-Level KFAC Methods for Training Deep Neural Networks","created":"2023-03-31","cited_by_count":0,"area":null},{"id":"2310.07032","title":"Neural Harmonium: An Interpretable Deep Structure for Nonlinear Dynamic System Identification with Application to Audio Processing","created":"2023-10-10","cited_by_count":0,"area":null},{"id":"2312.16043","title":"An extended asymmetric sigmoid with Perceptron (SIGTRON) for imbalanced linear classification","created":"2023-12-26","cited_by_count":0,"area":null},{"id":"2505.13614","title":"Deterministic Bounds and Random Estimates of Metric Tensors on Neuromanifolds","created":"2025-05-19","cited_by_count":0,"area":null},{"id":"2605.18180","title":"Canonical Regularisation of Wide Feature-Learning Neural Networks","created":"2026-05-18","cited_by_count":0,"area":null}],"next_cursor":null}