{"total":68,"rows":[{"id":"2102.06810","title":"Understanding self-supervised Learning Dynamics without Contrastive Pairs","created":"2021-02-12","cited_by_count":256,"area":null},{"id":"2103.10427","title":"The Low-Rank Simplicity Bias in Deep Networks","created":"2021-03-18","cited_by_count":154,"area":null},{"id":"2107.11472","title":"Clipped Hyperbolic Classifiers Are Super-Hyperbolic Classifiers","created":"2021-07-23","cited_by_count":57,"area":null},{"id":"2107.01562","title":"Random Neural Networks in the Infinite Width Limit as Gaussian Processes","created":"2021-07-04","cited_by_count":44,"area":null},{"id":"2403.02241","title":"Neural Redshift: Random Networks are not Random Functions","created":"2024-03-04","cited_by_count":43,"area":null},{"id":"2301.12832","title":"Deep networks for system identification: a Survey","created":"2023-01-30","cited_by_count":37,"area":null},{"id":"2205.10217","title":"Memorization and Optimization in Deep Neural Networks with Minimum Over-parameterization","created":"2022-05-20","cited_by_count":36,"area":null},{"id":"2406.06811","title":"Learning Continually by Spectral Regularization","created":"2024-06-10","cited_by_count":34,"area":null},{"id":"2408.11804","title":"Approaching Deep Learning through the Spectral Dynamics of Weights","created":"2024-08-21","cited_by_count":31,"area":null},{"id":"2304.02840","title":"NTK-SAP: Improving neural network pruning by aligning training dynamics","created":"2023-04-06","cited_by_count":30,"area":null},{"id":"2106.03970","title":"Batch Normalization Orthogonalizes Representations in Deep Random Networks","created":"2021-06-07","cited_by_count":29,"area":null},{"id":"2403.02579","title":"Geometric Dynamics of Signal Propagation Predict Trainability of Transformers","created":"2024-03-05","cited_by_count":24,"area":null},{"id":"2109.09304","title":"Deformed semicircle law and concentration of nonlinear random matrices for ultra-wide neural networks","created":"2021-09-20","cited_by_count":21,"area":null},{"id":"2203.14661","title":"Random matrix analysis of deep neural network weight matrices","created":"2022-03-28","cited_by_count":21,"area":null},{"id":"2204.06274","title":"Overparameterized Linear Regression under Adversarial Attacks","created":"2022-04-13","cited_by_count":21,"area":null},{"id":"2306.01154","title":"The Law of Parsimony in Gradient Descent for Learning Deep Linear Networks","created":"2023-06-01","cited_by_count":20,"area":null},{"id":"2307.06092","title":"Quantitative CLTs in Deep Neural Networks","created":"2023-07-12","cited_by_count":20,"area":null},{"id":"2103.00673","title":"Convolutional Normalization: Improving Deep Convolutional Network Robustness and Training","created":"2021-03-01","cited_by_count":15,"area":null},{"id":"2206.15478","title":"On the Learning and Learnability of Quasimetrics","created":"2022-06-30","cited_by_count":15,"area":null},{"id":"2105.07741","title":"Activation function design for deep networks: linearity and effective initialisation","created":"2021-05-17","cited_by_count":13,"area":null},{"id":"2305.18399","title":"On the impact of activation and normalization in obtaining isometric embeddings at initialization","created":"2023-05-28","cited_by_count":13,"area":null},{"id":"2310.06379","title":"Understanding the Expressivity and Trainability of Fourier Neural Operator: A Mean-Field Perspective","created":"2023-10-10","cited_by_count":11,"area":null},{"id":"2310.13402","title":"Calibrating Neural Simulation-Based Inference with Differentiable Coverage Probability","created":"2023-10-20","cited_by_count":11,"area":null},{"id":"2311.18718","title":"The Feature Speed Formula: a flexible approach to scale hyper-parameters of deep neural networks","created":"2023-11-30","cited_by_count":11,"area":null},{"id":"2201.05974","title":"Fractional SDE-Net: Generation of Time Series Data with Long-term Memory","created":"2022-01-16","cited_by_count":9,"area":null},{"id":"2206.03927","title":"Boundary between noise and information applied to filtering neural network weight matrices","created":"2022-06-08","cited_by_count":9,"area":null},{"id":"2206.09513","title":"$C^*$-algebra Net: A New Approach Generalizing Neural Network Parameters to $C^*$-algebra","created":"2022-06-20","cited_by_count":9,"area":null},{"id":"2111.12143","title":"Critical Initialization of Wide and Deep Neural Networks through Partial Jacobians: General Theory and Applications","created":"2021-11-23","cited_by_count":8,"area":null},{"id":"2410.05499","title":"Unitary convolutions for learning on graphs and groups","created":"2024-10-07","cited_by_count":8,"area":null},{"id":"2210.05371","title":"On skip connections and normalisation layers in deep optimisation","created":"2022-10-10","cited_by_count":7,"area":null},{"id":"2103.13466","title":"Asymptotic Freeness of Layerwise Jacobians Caused by Invariance of Multilayer Perceptron: The Haar Orthogonal Case","created":"2021-03-24","cited_by_count":5,"area":null},{"id":"2301.13710","title":"On the Initialisation of Wide Low-Rank Feedforward Neural Networks","created":"2023-01-31","cited_by_count":5,"area":null},{"id":"2310.07765","title":"Feature Learning and Generalization in Deep Networks with Orthogonal Weights","created":"2023-10-11","cited_by_count":5,"area":null},{"id":"2312.17306","title":"Gradient Flossing: Improving Gradient Descent through Dynamic Control of Jacobians","created":"2023-12-28","cited_by_count":5,"area":null},{"id":"2402.16184","title":"Deep Neural Network Initialization with Sparsity Inducing Activations","created":"2024-02-25","cited_by_count":5,"area":null},{"id":"2106.10704","title":"Better Training using Weight-Constrained Stochastic Dynamics","created":"2021-06-20","cited_by_count":4,"area":null},{"id":"2110.11150","title":"Lottery Tickets with Nonzero Biases","created":"2021-10-21","cited_by_count":4,"area":null},{"id":"2201.04543","title":"Eigenvalue Distribution of Large Random Matrices Arising in Deep Neural Networks: Orthogonal Case","created":"2022-01-12","cited_by_count":4,"area":null},{"id":"2205.08601","title":"Universal characteristics of deep neural network loss surfaces from random matrix theory","created":"2022-05-17","cited_by_count":4,"area":null},{"id":"2206.01332","title":"Optimal Activation Functions for the Random Features Regression Model","created":"2022-05-31","cited_by_count":4,"area":null},{"id":"2106.03763","title":"Vanishing Curvature and the Power of Adaptive Methods in Randomly Initialized Deep Networks","created":"2021-06-07","cited_by_count":3,"area":null},{"id":"2111.00841","title":"Free Probability for predicting the performance of feed-forward fully connected neural networks","created":"2021-11-01","cited_by_count":3,"area":null},{"id":"2206.13568","title":"AutoInit: Automatic Initialization via Jacobian Tuning","created":"2022-06-27","cited_by_count":3,"area":null},{"id":"2311.05061","title":"Efficient Compression of Overparameterized Deep Models through Low-Dimensional Learning Dynamics","created":"2023-11-08","cited_by_count":3,"area":null},{"id":"2402.04783","title":"Analyzing the Neural Tangent Kernel of Periodically Activated Coordinate Networks","created":"2024-02-07","cited_by_count":3,"area":null},{"id":"2408.12385","title":"Sharper Bounds for Chebyshev Moment Matching, with Applications","created":"2024-08-22","cited_by_count":3,"area":null},{"id":"2109.00125","title":"A Weight Initialization Based on the Linear Product Structure for Neural Networks","created":"2021-09-01","cited_by_count":2,"area":null},{"id":"2205.13076","title":"On Bridging the Gap between Mean Field and Finite Width in Deep Random Neural Networks with Batch Normalization","created":"2022-05-25","cited_by_count":2,"area":null},{"id":"2212.01744","title":"Statistical Physics of Deep Neural Networks: Initialization toward Optimal Channels","created":"2022-12-04","cited_by_count":2,"area":null},{"id":"2307.00474","title":"Moments, Random Walks, and Limits for Spectrum Approximation","created":"2023-07-02","cited_by_count":2,"area":null},{"id":"2602.05779","title":"How Controlling the Variance can Improve Training Stability of Sparsely Activated DNNs and CNNs","created":"2026-02-05","cited_by_count":2,"area":null},{"id":"2204.07879","title":"Polynomial-time Sparse Measure Recovery: From Mean Field Theory to Algorithm Design","created":"2022-04-16","cited_by_count":1,"area":null},{"id":"2301.06956","title":"Expected Gradients of Maxout Networks and Consequences to Parameter Initialization","created":"2023-01-17","cited_by_count":1,"area":null},{"id":"2410.20107","title":"Emergence of Globally Attracting Fixed Points in Deep Neural Networks With Nonlinear Activations","created":"2024-10-26","cited_by_count":1,"area":null},{"id":"2501.04182","title":"Random weights of DNNs and emergence of fixed points","created":"2025-01-07","cited_by_count":1,"area":null},{"id":"2506.07975","title":"Hyperpruning: Efficient Search through Pruned Variants of Recurrent Neural Networks Leveraging Lyapunov Spectrum","created":"2025-06-09","cited_by_count":1,"area":null},{"id":"2510.06685","title":"Gaussian Equivalence for Self-Attention: Asymptotic Spectral Analysis of Attention Matrix","created":"2025-10-08","cited_by_count":1,"area":null},{"id":"2510.22652","title":"If You Want to Be Robust, Be Wary of Initialization","created":"2025-10-26","cited_by_count":1,"area":null},{"id":"2602.12384","title":"Why Deep Jacobian Spectra Separate: Depth-Induced Scaling and Singular-Vector Alignment","created":"2026-02-12","cited_by_count":1,"area":null},{"id":"2605.09861","title":"Flag Varieties: A Geometric Framework for Deep Network Alignment","created":"2026-05-11","cited_by_count":1,"area":null},{"id":"2606.09762","title":"Preserving Plasticity in Continual Learning via Dynamical Isometry","created":"2026-06-08","cited_by_count":1,"area":null},{"id":"2102.13333","title":"Layer-Wise Interpretation of Deep Neural Networks Using Identity Initialization","created":"2021-02-26","cited_by_count":0,"area":null},{"id":"2106.04088","title":"A Lightweight and Gradient-Stable Neural Layer","created":"2021-06-08","cited_by_count":0,"area":null},{"id":"2203.12967","title":"Extended critical regimes of deep neural networks","created":"2022-03-24","cited_by_count":0,"area":null},{"id":"2210.02411","title":"Dynamical Isometry for Residual Networks","created":"2022-10-05","cited_by_count":0,"area":null},{"id":"2608.14638","title":"Randomly initialized autoencoders: fixed points and edge-of-chaos","created":"2026-07-28","cited_by_count":0,"area":null},{"id":"2608.16084","title":"Eigenanalysis framework for autoregressive neural emulators of multi-scale chaotic dynamics","created":"2026-08-17","cited_by_count":0,"area":null},{"id":"2609.39190","title":"Dynamics to decision: A mathematical theory of Lyapunov spectra and decision boundaries in deep classifiers","created":"2026-09-30","cited_by_count":0,"area":null}],"next_cursor":null}