{"total":47,"rows":[{"id":"2303.01486","title":"Understanding plasticity in neural networks","created":"2023-03-02","cited_by_count":174,"area":null},{"id":"2206.00133","title":"Pre-training via Denoising for Molecular Property Prediction","created":"2022-05-31","cited_by_count":124,"area":null},{"id":"2203.01238","title":"On the Optimization Landscape of Neural Collapse under MSE Loss: Global Optimality with Unconstrained Features","created":"2022-03-02","cited_by_count":97,"area":null},{"id":"2211.13672","title":"A Self-Attention Ansatz for Ab-initio Quantum Chemistry","created":"2022-11-24","cited_by_count":49,"area":null},{"id":"2306.17759","title":"The Shaped Transformer: Attention Models in the Infinite Depth-and-Width Limit","created":"2023-06-30","cited_by_count":47,"area":null},{"id":"2302.10322","title":"Deep Transformers without Shortcuts: Modifying Self-attention for Faithful Signal Propagation","created":"2023-02-20","cited_by_count":45,"area":null},{"id":"2206.02768","title":"The Neural Covariance SDE: Shaped Infinite Depth-and-Width Networks at Initialization","created":"2022-06-06","cited_by_count":41,"area":null},{"id":"2210.06640","title":"Compute-Efficient Deep Learning: Algorithmic Trends and Opportunities","created":"2022-10-13","cited_by_count":38,"area":null},{"id":"2311.01906","title":"Simplifying Transformer Blocks","created":"2023-11-03","cited_by_count":37,"area":null},{"id":"2209.11208","title":"A Closer Look at Learned Optimization: Stability, Robustness, and Inductive Biases","created":"2022-09-22","cited_by_count":30,"area":null},{"id":"2203.08120","title":"Deep Learning without Shortcuts: Shaping the Kernel with Tailored Rectifiers","created":"2022-03-15","cited_by_count":28,"area":null},{"id":"2402.10127","title":"Nonlinear spiked covariance matrices and signal propagation in deep neural networks","created":"2024-02-15","cited_by_count":26,"area":null},{"id":"2403.02579","title":"Geometric Dynamics of Signal Propagation Predict Trainability of Transformers","created":"2024-03-05","cited_by_count":24,"area":null},{"id":"2208.13614","title":"Neural Tangent Kernel: A Survey","created":"2022-08-29","cited_by_count":23,"area":null},{"id":"2210.00688","title":"On the infinite-depth limit of finite-width neural networks","created":"2022-10-03","cited_by_count":22,"area":null},{"id":"2302.00453","title":"Width and Depth Limits Commute in Residual Networks","created":"2023-02-01","cited_by_count":21,"area":null},{"id":"2210.03651","title":"Understanding the Covariance Structure of Convolutional Filters","created":"2022-10-07","cited_by_count":16,"area":null},{"id":"2305.18399","title":"On the impact of activation and normalization in obtaining isometric embeddings at initialization","created":"2023-05-28","cited_by_count":13,"area":null},{"id":"2202.06438","title":"Learning from Randomly Initialized Neural Network Features","created":"2022-02-13","cited_by_count":12,"area":null},{"id":"2312.12474","title":"Principled Weight Initialisation for Input-Convex Neural Networks","created":"2023-12-19","cited_by_count":12,"area":null},{"id":"2401.10809","title":"Neglected Hessian component explains mysteries in Sharpness regularization","created":"2024-01-19","cited_by_count":12,"area":null},{"id":"2405.19279","title":"Understanding and Minimising Outlier Features in Neural Network Training","created":"2024-05-29","cited_by_count":10,"area":null},{"id":"2205.12379","title":"Gaussian Pre-Activations in Neural Networks: Myth or Reality?","created":"2022-05-24","cited_by_count":9,"area":null},{"id":"2111.12143","title":"Critical Initialization of Wide and Deep Neural Networks through Partial Jacobians: General Theory and Applications","created":"2021-11-23","cited_by_count":8,"area":null},{"id":"2207.09432","title":"Deep equilibrium networks are sensitive to initialization statistics","created":"2022-07-19","cited_by_count":8,"area":null},{"id":"2310.02012","title":"Towards Training Without Depth Limits: Batch Normalization Without Gradient Explosion","created":"2023-10-03","cited_by_count":8,"area":null},{"id":"2510.00345","title":"Cutting the Skip: Training Residual-Free Transformers","created":"2025-09-30","cited_by_count":8,"area":null},{"id":"2208.01134","title":"Improving the Trainability of Deep Neural Networks through Layerwise Batch-Entropy Regularization","created":"2022-08-01","cited_by_count":7,"area":null},{"id":"2210.05371","title":"On skip connections and normalisation layers in deep optimisation","created":"2022-10-10","cited_by_count":7,"area":null},{"id":"2204.11231","title":"Do ReLU Networks Have An Edge When Approximating Compactly-Supported Functions?","created":"2022-04-24","cited_by_count":6,"area":null},{"id":"2506.16884","title":"The Importance of Being Lazy: Scaling Limits of Continual Learning","created":"2025-06-20","cited_by_count":6,"area":null},{"id":"2403.04747","title":"GNN-VPA: A Variance-Preserving Aggregation Strategy for Graph Neural Networks","created":"2024-03-07","cited_by_count":5,"area":null},{"id":"2310.12079","title":"Differential Equation Scaling Limits of Shaped and Unshaped Neural Networks","created":"2023-10-18","cited_by_count":4,"area":null},{"id":"2411.17278","title":"The Exploration of Neural Collapse under Imbalanced Data","created":"2024-11-26","cited_by_count":4,"area":null},{"id":"2602.10408","title":"Gated Normalization Removal and Scale Anchoring in Pre-Norm Transformers","created":"2026-02-11","cited_by_count":4,"area":null},{"id":"2605.25880","title":"The Quantization Benefits of Residual-Free Transformers","created":"2026-05-25","cited_by_count":4,"area":null},{"id":"2202.00834","title":"Nonlinear Initialization Methods for Low-Rank Neural Networks","created":"2022-02-02","cited_by_count":3,"area":null},{"id":"2206.13568","title":"AutoInit: Automatic Initialization via Jacobian Tuning","created":"2022-06-27","cited_by_count":3,"area":null},{"id":"2302.09712","title":"Depth Degeneracy in Neural Networks: Vanishing Angles in Fully Connected ReLU Networks on Initialization","created":"2023-02-20","cited_by_count":3,"area":null},{"id":"2602.05779","title":"How Controlling the Variance can Improve Training Stability of Sparsely Activated DNNs and CNNs","created":"2026-02-05","cited_by_count":2,"area":null},{"id":"2310.01683","title":"Commutative Width and Depth Scaling in Deep Neural Networks","created":"2023-10-02","cited_by_count":1,"area":null},{"id":"2602.05996","title":"Orthogonal Self-Attention","created":"2026-02-05","cited_by_count":1,"area":null},{"id":"2605.30860","title":"Bayesian Inference with Shaped Deep Non-linear MLPs","created":"2026-05-29","cited_by_count":1,"area":null},{"id":"2606.09762","title":"Preserving Plasticity in Continual Learning via Dynamical Isometry","created":"2026-06-08","cited_by_count":1,"area":null},{"id":"2506.14386","title":"ResNets Are Deeper Than You Think","created":"2025-06-17","cited_by_count":0,"area":null},{"id":"2602.08287","title":"Noise Stability of Transformer Models","created":"2026-02-09","cited_by_count":0,"area":null},{"id":"2609.09244","title":"Critical initialization destabilizes higher input derivatives in wide scalar-input networks","created":"2026-09-08","cited_by_count":0,"area":null}],"next_cursor":null}