{"total":58,"rows":[{"id":"2102.06171","title":"High-Performance Large-Scale Image Recognition Without Normalization","created":"2021-02-11","cited_by_count":360,"area":null},{"id":"2303.01486","title":"Understanding plasticity in neural networks","created":"2023-03-02","cited_by_count":174,"area":null},{"id":"2508.05629","title":"On the Generalization of SFT: A Reinforcement Learning Perspective with Reward Rectification","created":"2025-08-07","cited_by_count":127,"area":"lr"},{"id":"2101.08692","title":"Characterizing signal propagation to close the performance gap in unnormalized ResNets","created":"2021-01-21","cited_by_count":88,"area":null},{"id":"2206.08720","title":"Fast Finite Width Neural Tangent Kernel","created":"2022-06-17","cited_by_count":62,"area":null},{"id":"2502.10818","title":"On Vanishing Gradients, Over-Smoothing, and Over-Squashing in GNNs: Bridging Recurrent and Graph Learning","created":"2025-02-15","cited_by_count":43,"area":null},{"id":"2110.04369","title":"A Loss Curvature Perspective on Training Instability in Deep Learning","created":"2021-10-08","cited_by_count":40,"area":null},{"id":"2311.01906","title":"Simplifying Transformer Blocks","created":"2023-11-03","cited_by_count":37,"area":null},{"id":"2406.02997","title":"Residual Connections and Normalization Can Provably Prevent Oversmoothing in GNNs","created":"2024-06-05","cited_by_count":34,"area":null},{"id":"2106.03970","title":"Batch Normalization Orthogonalizes Representations in Deep Random Networks","created":"2021-06-07","cited_by_count":29,"area":null},{"id":"2203.08120","title":"Deep Learning without Shortcuts: Shaping the Kernel with Tailored Rectifiers","created":"2022-03-15","cited_by_count":28,"area":null},{"id":"2106.05956","title":"Beyond BatchNorm: Towards a Unified Understanding of Normalization in Deep Learning","created":"2021-06-10","cited_by_count":25,"area":null},{"id":"2102.01670","title":"Keep the Gradients Flowing: Using Gradient Flow to Study Sparse Network Optimization","created":"2021-02-02","cited_by_count":22,"area":null},{"id":"2106.15739","title":"On the Periodic Behavior of Neural Network Training with Batch Normalization and Weight Decay","created":"2021-06-29","cited_by_count":20,"area":null},{"id":"2104.08215","title":"\"BNN - BN = ?\": Training Binary Neural Networks without Batch Normalization","created":"2021-04-16","cited_by_count":17,"area":null},{"id":"2206.11925","title":"Set Norm and Equivariant Skip Connections: Putting the Deep in Deep Sets","created":"2022-06-23","cited_by_count":17,"area":null},{"id":"2302.07937","title":"The Expressive Power of Tuning Only the Normalization Layers","created":"2023-02-15","cited_by_count":13,"area":null},{"id":"2305.18399","title":"On the impact of activation and normalization in obtaining isometric embeddings at initialization","created":"2023-05-28","cited_by_count":13,"area":null},{"id":"2106.03743","title":"Proxy-Normalizing Activations to Match Batch Normalization while Removing Batch Dependence","created":"2021-06-07","cited_by_count":12,"area":null},{"id":"2405.19279","title":"Understanding and Minimising Outlier Features in Neural Network Training","created":"2024-05-29","cited_by_count":10,"area":null},{"id":"2309.04644","title":"Towards Understanding Neural Collapse: The Effects of Batch Normalization and Weight Decay","created":"2023-09-09","cited_by_count":9,"area":null},{"id":"2507.12709","title":"From SGD to Spectra: A Theory of Neural Network Weight Dynamics","created":"2025-07-17","cited_by_count":9,"area":null},{"id":"2111.12143","title":"Critical Initialization of Wide and Deep Neural Networks through Partial Jacobians: General Theory and Applications","created":"2021-11-23","cited_by_count":8,"area":null},{"id":"2209.14778","title":"Batch Normalization Explained","created":"2022-09-29","cited_by_count":8,"area":null},{"id":"2303.06530","title":"Making Batch Normalization Great in Federated Deep Learning","created":"2023-03-12","cited_by_count":8,"area":null},{"id":"2306.11680","title":"The Implicit Bias of Batch Normalization in Linear Models and Two-layer Linear Convolutional Neural Networks","created":"2023-06-20","cited_by_count":8,"area":null},{"id":"2310.02012","title":"Towards Training Without Depth Limits: Batch Normalization Without Gradient Explosion","created":"2023-10-03","cited_by_count":8,"area":null},{"id":"2108.01110","title":"Batch Normalization Preconditioning for Neural Network Training","created":"2021-08-02","cited_by_count":5,"area":null},{"id":"2301.13710","title":"On the Initialisation of Wide Low-Rank Feedforward Neural Networks","created":"2023-01-31","cited_by_count":5,"area":null},{"id":"2401.10432","title":"A2Q+: Improving Accumulator-Aware Weight Quantization","created":"2024-01-19","cited_by_count":5,"area":null},{"id":"2402.16184","title":"Deep Neural Network Initialization with Sparsity Inducing Activations","created":"2024-02-25","cited_by_count":5,"area":null},{"id":"2506.00846","title":"Infinite-Width Limit of a Single Attention Layer: Analysis via Tensor Programs","created":"2025-06-01","cited_by_count":5,"area":null},{"id":"2110.11150","title":"Lottery Tickets with Nonzero Biases","created":"2021-10-21","cited_by_count":4,"area":null},{"id":"2306.00700","title":"On the Weight Dynamics of Deep Normalized Networks","created":"2023-06-01","cited_by_count":4,"area":null},{"id":"2403.20284","title":"LayerNorm: A key component in parameter-efficient fine-tuning","created":"2024-03-29","cited_by_count":4,"area":null},{"id":"2406.00396","title":"Stochastic Resetting Mitigates Latent Gradient Bias of SGD from Label Noise","created":"2024-06-01","cited_by_count":4,"area":null},{"id":"2106.03763","title":"Vanishing Curvature and the Power of Adaptive Methods in Randomly Initialized Deep Networks","created":"2021-06-07","cited_by_count":3,"area":null},{"id":"2110.13989","title":"Revisiting Batch Norm Initialization","created":"2021-10-26","cited_by_count":3,"area":null},{"id":"2205.15146","title":"Batch Normalization Is Blind to the First and Second Derivatives of the Loss","created":"2022-05-30","cited_by_count":3,"area":null},{"id":"2206.13568","title":"AutoInit: Automatic Initialization via Jacobian Tuning","created":"2022-06-27","cited_by_count":3,"area":null},{"id":"2112.00265","title":"Training BatchNorm Only in Neural Architecture Search and Beyond","created":"2021-12-01","cited_by_count":2,"area":null},{"id":"2205.13076","title":"On Bridging the Gap between Mean Field and Finite Width in Deep Random Neural Networks with Batch Normalization","created":"2022-05-25","cited_by_count":2,"area":null},{"id":"2304.10714","title":"Picking Up Quantization Steps for Compressed Image Classification","created":"2023-04-21","cited_by_count":2,"area":null},{"id":"2403.15855","title":"Initialisation and Network Effects in Decentralised Federated Learning","created":"2024-03-23","cited_by_count":2,"area":null},{"id":"2407.17834","title":"Towards the Spectral bias Alleviation by Normalizations in Coordinate Networks","created":"2024-07-25","cited_by_count":2,"area":null},{"id":"2110.09974","title":"UniFed: A Unified Framework for Federated Learning on Non-IID Image Features","created":"2021-10-19","cited_by_count":1,"area":null},{"id":"2304.11692","title":"The Disharmony between BN and ReLU Causes Gradient Explosion, but is Offset by the Correlation between Activations","created":"2023-04-23","cited_by_count":1,"area":null},{"id":"2410.20107","title":"Emergence of Globally Attracting Fixed Points in Deep Neural Networks With Nonlinear Activations","created":"2024-10-26","cited_by_count":1,"area":null},{"id":"2507.06464","title":"SoftSignSGD(S3): An Enhanced Optimizer for Practical DNN Training and Loss Spikes Minimization Beyond Adam","created":"2025-07-09","cited_by_count":1,"area":null},{"id":"2605.04946","title":"Training-Time Batch Normalization Reshapes Local Partition Geometry in Piecewise-Affine Networks","created":"2026-05-06","cited_by_count":1,"area":null},{"id":"2208.04468","title":"Deep Maxout Network Gaussian Process","created":"2022-08-08","cited_by_count":0,"area":null},{"id":"2311.15993","title":"Unified Batch Normalization: Identifying and Alleviating the Feature Condensation in Batch Normalization and a Unified Framework","created":"2023-11-27","cited_by_count":0,"area":null},{"id":"2412.02843","title":"Batch Normalization Decomposed","created":"2024-12-03","cited_by_count":0,"area":null},{"id":"2501.03571","title":"AADNet: Exploring EEG Spatiotemporal Information for Fast and Accurate Orientation and Timbre Detection of Auditory Attention Based on A Cue-Masked Paradigm","created":"2025-01-07","cited_by_count":0,"area":null},{"id":"2506.14386","title":"ResNets Are Deeper Than You Think","created":"2025-06-17","cited_by_count":0,"area":null},{"id":"2604.16809","title":"A Mechanism Study of Delayed Loss Spikes in Batch-Normalized Linear Models","created":"2026-04-18","cited_by_count":0,"area":null},{"id":"2605.26012","title":"Learning in Low-Dimensional Subspaces: Orthogonal Bottlenecks for Reinforcement Learning","created":"2026-05-25","cited_by_count":0,"area":"deeprl"},{"id":"2606.06539","title":"Synthetic Benchmarks Overstate Forward-Forward Scaling: Real-Data Limits of Layer-Local Training","created":"2026-06-04","cited_by_count":0,"area":null}],"next_cursor":null}