{"total":124,"rows":[{"id":"2312.02696","title":"Analyzing and Improving the Training Dynamics of Diffusion Models","created":"2023-12-05","cited_by_count":402,"area":"diffusion"},{"id":"2210.01117","title":"Omnigrok: Grokking Beyond Algorithmic Data","created":"2022-10-03","cited_by_count":146,"area":null},{"id":"2202.05306","title":"Characterizing and overcoming the greedy nature of learning in multi-modal deep neural networks","created":"2022-02-10","cited_by_count":95,"area":null},{"id":"2206.07085","title":"Understanding the Generalization Benefit of Normalization Layers: Sharpness Reduction","created":"2022-06-14","cited_by_count":86,"area":null},{"id":"2310.04415","title":"Why Do We Need Weight Decay in Modern Deep Learning?","created":"2023-10-06","cited_by_count":72,"area":null},{"id":"2403.05231","title":"Tracking Meets LoRA: Faster Training, Larger Model, Stronger Performance","created":"2024-03-08","cited_by_count":70,"area":null},{"id":"2105.05246","title":"Spectral Normalisation for Deep Reinforcement Learning: an Optimisation Perspective","created":"2021-05-11","cited_by_count":65,"area":null},{"id":"2407.01800","title":"Normalization and effective learning rates in reinforcement learning","created":"2024-07-01","cited_by_count":58,"area":"deeprl"},{"id":"2305.17212","title":"Rotational Equilibrium: How Weight Decay Balances Learning Across Neural Networks","created":"2023-05-26","cited_by_count":53,"area":null},{"id":"2105.02716","title":"Noether's Learning Dynamics: Role of Symmetry Breaking in Neural Networks","created":"2021-05-06","cited_by_count":50,"area":null},{"id":"2212.14474","title":"Learning 3D Human Pose Estimation from Dozens of Datasets using a Geometry-Aware Autoencoder to Bridge Between Skeleton Formats","created":"2022-12-29","cited_by_count":50,"area":null},{"id":"2103.17268","title":"Fast Certified Robust Training with Short Warmup","created":"2021-03-31","cited_by_count":46,"area":null},{"id":"2308.16258","title":"Robust Principles: Architectural Design Principles for Adversarially Robust CNNs","created":"2023-08-30","cited_by_count":46,"area":null},{"id":"2405.13698","title":"How to set AdamW's weight decay as you scale model and dataset size","created":"2024-05-22","cited_by_count":43,"area":null},{"id":"2505.13738","title":"Power Lines: Scaling Laws for Weight Decay and Batch Size in LLM Pre-training","created":"2025-05-19","cited_by_count":43,"area":null},{"id":"2506.13018","title":"Symmetry in Neural Network Parameter Spaces","created":"2025-06-16","cited_by_count":36,"area":null},{"id":"2210.17216","title":"Symmetries, flat minima, and the conserved quantities of gradient flow","created":"2022-10-31","cited_by_count":35,"area":null},{"id":"2405.03658","title":"A review on data-driven constitutive laws for solids","created":"2024-05-06","cited_by_count":35,"area":null},{"id":"2408.11804","title":"Approaching Deep Learning through the Spectral Dynamics of Weights","created":"2024-08-21","cited_by_count":31,"area":null},{"id":"2202.00980","title":"Robust Training of Neural Networks Using Scale Invariant Architectures","created":"2022-02-02","cited_by_count":29,"area":null},{"id":"2206.08900","title":"Adapting the Linearised Laplace Model Evidence for Modern Deep Learning","created":"2022-06-17","cited_by_count":29,"area":null},{"id":"2410.23819","title":"Weight decay induces low-rank attention layers","created":"2024-10-31","cited_by_count":27,"area":null},{"id":"2205.10637","title":"Symmetry Teleportation for Accelerated Optimization","created":"2022-05-21","cited_by_count":25,"area":null},{"id":"2305.13404","title":"Improving Convergence and Generalization Using Parameter Symmetries","created":"2023-05-22","cited_by_count":23,"area":null},{"id":"2106.15739","title":"On the Periodic Behavior of Neural Network Training with Batch Normalization and Weight Decay","created":"2021-06-29","cited_by_count":20,"area":null},{"id":"2510.19093","title":"Weight Decay may matter more than muP for Learning Rate Transfer in Practice","created":"2025-10-21","cited_by_count":20,"area":null},{"id":"2209.03695","title":"Training Scale-Invariant Neural Networks on the Sphere Can Happen in Three Regimes","created":"2022-09-08","cited_by_count":19,"area":null},{"id":"2210.03277","title":"Rethinking Normalization Methods in Federated Learning","created":"2022-10-07","cited_by_count":19,"area":null},{"id":"2502.07523","title":"Scaling Off-Policy Reinforcement Learning with Batch and Weight Normalization","created":"2025-02-11","cited_by_count":19,"area":"deeprl"},{"id":"2509.25174","title":"XQC: Well-conditioned Optimization Accelerates Deep Reinforcement Learning","created":"2025-09-29","cited_by_count":17,"area":"deeprl"},{"id":"2205.11921","title":"Compression-aware Training of Neural Networks using Frank-Wolfe","created":"2022-05-24","cited_by_count":16,"area":null},{"id":"2606.16899","title":"Fantastic Pretraining Optimizers and Where to Find Them II: Hyperball Optimization","created":"2026-06-15","cited_by_count":16,"area":null},{"id":"2404.11207","title":"Exploring the Transferability of Visual Prompting for Multimodal Large Language Models","created":"2024-04-17","cited_by_count":15,"area":"mllm"},{"id":"2410.03249","title":"How Much Can We Forget about Data Contamination?","created":"2024-10-04","cited_by_count":14,"area":null},{"id":"2210.15898","title":"Toward Equation of Motion for Deep Neural Networks: Continuous-time Gradient Descent and Discretization Error Analysis","created":"2022-10-28","cited_by_count":13,"area":null},{"id":"2506.14562","title":"AlphaDecay: Module-wise Weight Decay for Heavy-Tailed Balancing in LLMs","created":"2025-06-17","cited_by_count":13,"area":null},{"id":"2106.03743","title":"Proxy-Normalizing Activations to Match Batch Normalization while Removing Batch Dependence","created":"2021-06-07","cited_by_count":12,"area":null},{"id":"2206.05658","title":"Improving Pre-trained Language Model Fine-tuning with Noise Stability Regularization","created":"2022-06-12","cited_by_count":12,"area":null},{"id":"2412.18260","title":"Investigating Large Language Models for Code Vulnerability Detection: An Experimental Study","created":"2024-12-24","cited_by_count":12,"area":null},{"id":"2103.12682","title":"How to decay your learning rate","created":"2021-03-23","cited_by_count":11,"area":null},{"id":"2311.18718","title":"The Feature Speed Formula: a flexible approach to scale hyper-parameters of deep neural networks","created":"2023-11-30","cited_by_count":11,"area":null},{"id":"2404.02113","title":"Position: Lifetime tuning is incompatible with continual reinforcement learning","created":"2024-04-02","cited_by_count":11,"area":"deeprl"},{"id":"2210.09020","title":"Defects of Convolutional Decoder Networks in Frequency Representation","created":"2022-10-17","cited_by_count":10,"area":null},{"id":"2401.14424","title":"Discovering Mathematical Formulas from Data via GPT-guided Monte Carlo Tree Search","created":"2024-01-24","cited_by_count":10,"area":null},{"id":"2203.00089","title":"Amortized Proximal Optimization","created":"2022-02-28","cited_by_count":9,"area":null},{"id":"2309.04644","title":"Towards Understanding Neural Collapse: The Effects of Batch Normalization and Weight Decay","created":"2023-09-09","cited_by_count":9,"area":null},{"id":"2301.12540","title":"Implicit Regularization for Group Sparsity","created":"2023-01-29","cited_by_count":8,"area":null},{"id":"2209.15208","title":"Scale-invariant Bayesian Neural Networks with Connectivity Tangent Kernel","created":"2022-09-30","cited_by_count":7,"area":null},{"id":"2605.19095","title":"ScheduleFree+: Scaling Learning-Rate-Free & Schedule-Free Learning to Large Language Models","created":"2026-05-18","cited_by_count":7,"area":null},{"id":"2103.06733","title":"Intraclass clustering: an implicit learning ability that regularizes DNNs","created":"2021-03-11","cited_by_count":6,"area":null},{"id":"2410.14837","title":"Topological obstruction to the training of shallow ReLU neural networks","created":"2024-10-18","cited_by_count":6,"area":null},{"id":"2108.01110","title":"Batch Normalization Preconditioning for Neural Network Training","created":"2021-08-02","cited_by_count":5,"area":null},{"id":"2305.15912","title":"Neural Characteristic Activation Analysis and Geometric Parameterization for ReLU Networks","created":"2023-05-25","cited_by_count":5,"area":null},{"id":"2507.21449","title":"From Global to Local: A Scalable Benchmark for Local Posterior Sampling","created":"2025-07-29","cited_by_count":5,"area":null},{"id":"2604.01083","title":"TRACE: Training-Free Partial Audio Deepfake Detection via Embedding Trajectory Analysis of Speech Foundation Models","created":"2026-04-01","cited_by_count":5,"area":null},{"id":"2604.04539","title":"FlashSAC: Fast and Stable Off-Policy Reinforcement Learning for High-Dimensional Robot Control","created":"2026-04-06","cited_by_count":5,"area":"deeprl"},{"id":"2112.13553","title":"Classification of Histopathology Images of Lung Cancer Using Convolutional Neural Network (CNN)","created":"2021-12-27","cited_by_count":4,"area":null},{"id":"2201.05020","title":"Automatic Sparse Connectivity Learning for Neural Networks","created":"2022-01-13","cited_by_count":4,"area":null},{"id":"2202.02800","title":"Learning to be a Statistician: Learned Estimator for Number of Distinct Values","created":"2022-02-06","cited_by_count":4,"area":null},{"id":"2204.02027","title":"A Survey on Dropout Methods and Experimental Verification in Recommendation","created":"2022-04-05","cited_by_count":4,"area":null},{"id":"2306.00700","title":"On the Weight Dynamics of Deep Normalized Networks","created":"2023-06-01","cited_by_count":4,"area":null},{"id":"2410.11985","title":"The Fair Language Model Paradox","created":"2024-10-15","cited_by_count":4,"area":null},{"id":"2506.01016","title":"Optimistic critics can empower small actors","created":"2025-06-01","cited_by_count":4,"area":"deeprl"},{"id":"2607.22444","title":"Hyperball May Not Be a Free Lunch","created":"2026-07-24","cited_by_count":4,"area":null},{"id":"2103.15345","title":"FixNorm: Dissecting Weight Decay for Training Deep Neural Networks","created":"2021-03-29","cited_by_count":3,"area":null},{"id":"2205.15146","title":"Batch Normalization Is Blind to the First and Second Derivatives of the Loss","created":"2022-05-30","cited_by_count":3,"area":null},{"id":"2605.23061","title":"Anytime Training with Schedule-Free Spectral Optimization","created":"2026-05-21","cited_by_count":3,"area":null},{"id":"2606.23637","title":"Muown Implicitly Performs Angular Step-size Decay","created":"2026-06-22","cited_by_count":3,"area":null},{"id":"2606.25971","title":"Improving Neural Network Training by Decoupling the Magnitude and Direction of Weight Vectors","created":"2026-06-24","cited_by_count":3,"area":"moe"},{"id":"2608.24814","title":"Effective Learning Rate Governs Loss Dynamics in Language Model Pretraining","created":"2026-08-25","cited_by_count":3,"area":null},{"id":"2107.06386","title":"Geometry and Generalization: Eigenvalues as predictors of where a network will fail to generalize","created":"2021-07-13","cited_by_count":2,"area":null},{"id":"2110.00075","title":"Noise2Recon: Enabling Joint MRI Reconstruction and Denoising with Semi-Supervised and Self-Supervised Learning","created":"2021-09-30","cited_by_count":2,"area":null},{"id":"2210.03069","title":"PathProx: A Proximal Gradient Algorithm for Weight Decay Regularized Deep Neural Networks","created":"2022-10-06","cited_by_count":2,"area":null},{"id":"2303.11602","title":"Convergence of variational Monte Carlo simulation and scale-invariant pre-training","created":"2023-03-21","cited_by_count":2,"area":null},{"id":"2308.12053","title":"Efficient and Flexible Neural Network Training through Layer-wise Feedback Propagation","created":"2023-08-23","cited_by_count":2,"area":null},{"id":"2309.16109","title":"Feature Normalization Prevents Collapse of Non-contrastive Learning Dynamics","created":"2023-09-28","cited_by_count":2,"area":null},{"id":"2408.16612","title":"Data Quality Monitoring for the Hadron Calorimeters Using Transfer Learning for Anomaly Detection","created":"2024-08-29","cited_by_count":2,"area":null},{"id":"2504.15399","title":"Improving Learning to Optimize Using Parameter Symmetries","created":"2025-04-21","cited_by_count":2,"area":null},{"id":"2510.04686","title":"How does the optimizer implicitly bias the model merging loss landscape?","created":"2025-10-06","cited_by_count":2,"area":null},{"id":"2606.29158","title":"On the Nonlinearity of Learning Rate Scaling for LLM Training","created":"2026-06-28","cited_by_count":2,"area":null},{"id":"2606.29176","title":"Dead-Direction Conditioners: Gauge-Equivariant Preconditioning for Deep Networks","created":"2026-06-28","cited_by_count":2,"area":null},{"id":"2607.23777","title":"Scale Weight Decay and Train Better","created":"2026-07-26","cited_by_count":2,"area":null},{"id":"2102.03497","title":"Weight Rescaling: Effective and Robust Regularization for Deep Neural Networks with Batch Normalization","created":"2021-02-06","cited_by_count":1,"area":null},{"id":"2111.02154","title":"Regularization by Misclassification in ReLU Neural Networks","created":"2021-11-03","cited_by_count":1,"area":null},{"id":"2205.07260","title":"Guidelines for the Regularization of Gammas in Batch Normalization for Deep Residual Networks","created":"2022-05-15","cited_by_count":1,"area":null},{"id":"2302.01947","title":"Extracting the gamma-ray source-count distribution below the Fermi-LAT detection limit with deep learning","created":"2023-02-03","cited_by_count":1,"area":null},{"id":"2305.07448","title":"Deep Deterministic Policy Gradient for End-to-End Communication Systems without Prior Channel Knowledge","created":"2023-05-12","cited_by_count":1,"area":null},{"id":"2309.01694","title":"No Data Augmentation? Alternative Regularizations for Effective Training on Small Datasets","created":"2023-09-04","cited_by_count":1,"area":null},{"id":"2404.19112","title":"Hidden Synergy: $L_1$ Weight Normalization and 1-Path-Norm Regularization","created":"2024-04-29","cited_by_count":1,"area":null},{"id":"2501.11584","title":"GCSAM: Gradient Centralized Sharpness Aware Minimization","created":"2025-01-20","cited_by_count":1,"area":null},{"id":"2506.03758","title":"Scaling CrossQ with Weight Normalization","created":"2025-06-04","cited_by_count":1,"area":"deeprl"},{"id":"2507.04683","title":"Recovering Plasticity of Neural Networks via Soft Weight Rescaling","created":"2025-07-07","cited_by_count":1,"area":null},{"id":"2509.12774","title":"EmbeddedML: A New Optimized and Fast Machine Learning Library","created":"2025-09-16","cited_by_count":1,"area":null},{"id":"2605.04418","title":"Demystifying Manifold Constraints in LLM Pre-training","created":"2026-05-06","cited_by_count":1,"area":null},{"id":"2605.10734","title":"XQCfD: Accelerating Fast Actor-Critic Algorithms with Prior Data and Prior Policies","created":"2026-05-11","cited_by_count":1,"area":"deeprl"},{"id":"2605.16622","title":"Does Weight Decay Enhance Training Stability?","created":"2026-05-15","cited_by_count":1,"area":null},{"id":"2606.09762","title":"Preserving Plasticity in Continual Learning via Dynamical Isometry","created":"2026-06-08","cited_by_count":1,"area":null},{"id":"2607.21005","title":"Weight-norm Criticality: A Mechanism for Loss Spikes Induced by the Normalization and Weight Decay","created":"2026-07-23","cited_by_count":1,"area":null},{"id":"2608.23573","title":"Data Predictability Shapes Weibull Weight-Scale Growth in Transformer Training","created":"2026-06-27","cited_by_count":1,"area":null},{"id":"2105.01875","title":"Modulating Regularization Frequency for Efficient Compression-Aware Model Training","created":"2021-05-05","cited_by_count":0,"area":null}],"next_cursor":"100"}