{"total":42,"rows":[{"id":"2112.09153","title":"An Empirical Investigation of the Role of Pre-training in Lifelong Learning","created":"2021-12-16","cited_by_count":134,"area":null},{"id":"2405.00781","title":"Barren Plateaus in Variational Quantum Computing","created":"2024-05-01","cited_by_count":133,"area":null},{"id":"2102.04877","title":"Noisy Recurrent Neural Networks","created":"2021-02-09","cited_by_count":42,"area":null},{"id":"2212.13881","title":"Mechanism of feature learning in deep fully connected networks and kernel machines that recursively learn features","created":"2022-12-28","cited_by_count":25,"area":null},{"id":"2405.21064","title":"Recurrent neural networks: vanishing and exploding gradients are not the end of the story","created":"2024-05-31","cited_by_count":25,"area":null},{"id":"2109.13247","title":"The edge of chaos: quantum field theory and deep neural networks","created":"2021-09-27","cited_by_count":24,"area":null},{"id":"2306.01154","title":"The Law of Parsimony in Gradient Descent for Learning Deep Linear Networks","created":"2023-06-01","cited_by_count":20,"area":null},{"id":"2502.12920","title":"Lightweight Online Adaption for Time Series Foundation Model Forecasts","created":"2025-02-18","cited_by_count":16,"area":null},{"id":"2107.06898","title":"Towards quantifying information flows: relative entropy in deep neural networks and the renormalization group","created":"2021-07-14","cited_by_count":14,"area":null},{"id":"2101.07833","title":"Implicit Bias of Linear RNNs","created":"2021-01-19","cited_by_count":11,"area":null},{"id":"2111.12143","title":"Critical Initialization of Wide and Deep Neural Networks through Partial Jacobians: General Theory and Applications","created":"2021-11-23","cited_by_count":8,"area":null},{"id":"2210.09809","title":"Analysis of Convolutions, Non-linearity and Depth in Graph Neural Networks using Neural Tangent Kernel","created":"2022-10-18","cited_by_count":8,"area":null},{"id":"2310.14062","title":"On the Neural Tangent Kernel of Equilibrium Models","created":"2023-10-21","cited_by_count":7,"area":null},{"id":"2308.12585","title":"Persistent learning signals and working memory without continuous attractors","created":"2023-08-24","cited_by_count":6,"area":null},{"id":"2109.08958","title":"AutoInit: Analytic Signal-Preserving Weight Initialization for Neural Networks","created":"2021-09-18","cited_by_count":5,"area":null},{"id":"2210.01245","title":"Random orthogonal additive filters: a solution to the vanishing/exploding gradient of deep neural networks","created":"2022-10-03","cited_by_count":5,"area":null},{"id":"2301.13710","title":"On the Initialisation of Wide Low-Rank Feedforward Neural Networks","created":"2023-01-31","cited_by_count":5,"area":null},{"id":"2312.17306","title":"Gradient Flossing: Improving Gradient Descent through Dynamic Control of Jacobians","created":"2023-12-28","cited_by_count":5,"area":null},{"id":"2402.16184","title":"Deep Neural Network Initialization with Sparsity Inducing Activations","created":"2024-02-25","cited_by_count":5,"area":null},{"id":"2506.00846","title":"Infinite-Width Limit of a Single Attention Layer: Analysis via Tensor Programs","created":"2025-06-01","cited_by_count":5,"area":null},{"id":"2103.06583","title":"Preprint: Norm Loss: An efficient yet effective regularization method for deep neural networks","created":"2021-03-11","cited_by_count":3,"area":null},{"id":"2201.11016","title":"Recency Dropout for Recurrent Recommender Systems","created":"2022-01-26","cited_by_count":3,"area":null},{"id":"2204.04876","title":"Lyapunov-Guided Representation of Recurrent Neural Network Performance","created":"2022-04-11","cited_by_count":3,"area":null},{"id":"2304.04784","title":"Criticality versus uniformity in deep neural networks","created":"2023-04-10","cited_by_count":3,"area":null},{"id":"2311.05061","title":"Efficient Compression of Overparameterized Deep Models through Low-Dimensional Learning Dynamics","created":"2023-11-08","cited_by_count":3,"area":null},{"id":"2406.01755","title":"Sparser, Better, Deeper, Stronger: Improving Sparse Training with Exact Orthogonal Initialization","created":"2024-06-03","cited_by_count":3,"area":null},{"id":"2212.01744","title":"Statistical Physics of Deep Neural Networks: Initialization toward Optimal Channels","created":"2022-12-04","cited_by_count":2,"area":null},{"id":"2505.19827","title":"Revisiting Glorot Initialization for Long-Range Linear Recurrences","created":"2025-05-26","cited_by_count":2,"area":null},{"id":"2508.12121","title":"Time-Scale Coupling Between States and Parameters in Recurrent Neural Networks","created":"2025-08-16","cited_by_count":2,"area":null},{"id":"2510.04202","title":"Spectral Alignment as Predictor of Loss Explosion in Neural Network Training","created":"2025-10-05","cited_by_count":2,"area":null},{"id":"2605.14685","title":"Spontaneous symmetry breaking and Goldstone modes for deep information propagation","created":"2026-05-14","cited_by_count":2,"area":null},{"id":"2301.04900","title":"Stretched and measured neural predictions of complex network dynamics","created":"2023-01-12","cited_by_count":1,"area":null},{"id":"2303.06726","title":"Global Optimality of Elman-type RNN in the Mean-Field Regime","created":"2023-03-12","cited_by_count":1,"area":null},{"id":"2307.11462","title":"Improve Long-term Memory Learning Through Rescaling the Error Temporally","created":"2023-07-21","cited_by_count":1,"area":null},{"id":"2210.01348","title":"Fast Saturating Gate for Learning Long Time Scales with Recurrent Neural Networks","created":"2022-10-04","cited_by_count":0,"area":null},{"id":"2210.02411","title":"Dynamical Isometry for Residual Networks","created":"2022-10-05","cited_by_count":0,"area":null},{"id":"2306.15015","title":"Scaling and Resizing Symmetry in Feedforward Networks","created":"2023-06-26","cited_by_count":0,"area":null},{"id":"2512.05790","title":"Learnability Window in Gated Recurrent Neural Networks","created":"2025-12-05","cited_by_count":0,"area":null},{"id":"2605.05113","title":"How Long Does Infinite Width Last? Signal Propagation in Long-Range Linear Recurrences","created":"2026-05-06","cited_by_count":0,"area":null},{"id":"2605.29152","title":"Do Deep Networks Forget Initialization? A Forgetting-Time View of Practical Inductive Bias","created":"2026-05-27","cited_by_count":0,"area":null},{"id":"2608.09417","title":"Why Post-Norm Transformers Collapse: Attention Amplification and Gradient Repair Failure","created":"2026-08-10","cited_by_count":0,"area":null},{"id":"2609.09157","title":"Learning Length-Extrapolatable Recurrent Models","created":"2026-09-08","cited_by_count":0,"area":null}],"next_cursor":null}