{"total":113,"rows":[{"id":"2103.00065","title":"Gradient Descent on Neural Networks Typically Occurs at the Edge of Stability","created":"2021-02-26","cited_by_count":427,"area":null},{"id":"2205.10287","title":"On the SDEs and Scaling Rules for Adaptive Gradient Algorithms","created":"2022-05-20","cited_by_count":104,"area":null},{"id":"2110.02796","title":"An Unconstrained Layer-Peeled Perspective on Neural Collapse","created":"2021-10-06","cited_by_count":87,"area":null},{"id":"2206.07085","title":"Understanding the Generalization Benefit of Normalization Layers: Sharpness Reduction","created":"2022-06-14","cited_by_count":86,"area":null},{"id":"2102.12470","title":"On the Validity of Modeling SGD with Stochastic Differential Equations (SDEs)","created":"2021-02-24","cited_by_count":73,"area":null},{"id":"2310.04415","title":"Why Do We Need Weight Decay in Modern Deep Learning?","created":"2023-10-06","cited_by_count":72,"area":null},{"id":"2210.05337","title":"SGD with Large Step Sizes Learns Sparse Features","created":"2022-10-11","cited_by_count":68,"area":null},{"id":"2207.10299","title":"Learn From All: Erasing Attention Consistency for Noisy Label Facial Expression Recognition","created":"2022-07-21","cited_by_count":67,"area":null},{"id":"2201.05125","title":"GradMax: Growing Neural Networks using Gradient Information","created":"2022-01-13","cited_by_count":66,"area":null},{"id":"2109.14119","title":"Stochastic Training is Not Necessary for Generalization","created":"2021-09-29","cited_by_count":63,"area":null},{"id":"2404.04454","title":"Implicit Bias of AdamW: $\\ell_\\infty$ Norm Constrained Optimization","created":"2024-04-05","cited_by_count":58,"area":null},{"id":"2305.17212","title":"Rotational Equilibrium: How Weight Decay Balances Learning Across Neural Networks","created":"2023-05-26","cited_by_count":53,"area":null},{"id":"2105.02716","title":"Noether's Learning Dynamics: Role of Symmetry Breaking in Neural Networks","created":"2021-05-06","cited_by_count":50,"area":null},{"id":"2110.03677","title":"Large Learning Rate Tames Homogeneity: Convergence and Balancing Effect","created":"2021-10-07","cited_by_count":50,"area":null},{"id":"2110.11027","title":"FedGEMS: Federated Learning of Larger Server Models via Selective Knowledge Fusion","created":"2021-10-21","cited_by_count":49,"area":null},{"id":"2405.13698","title":"How to set AdamW's weight decay as you scale model and dataset size","created":"2024-05-22","cited_by_count":43,"area":null},{"id":"2505.13738","title":"Power Lines: Scaling Laws for Weight Decay and Batch Size in LLM Pre-training","created":"2025-05-19","cited_by_count":43,"area":null},{"id":"2202.00980","title":"Robust Training of Neural Networks Using Scale Invariant Architectures","created":"2022-02-02","cited_by_count":29,"area":null},{"id":"2103.15632","title":"Regular Polytope Networks","created":"2021-03-29","cited_by_count":24,"area":null},{"id":"2403.07548","title":"Online Continual Learning For Interactive Instruction Following Agents","created":"2024-03-12","cited_by_count":22,"area":null},{"id":"2503.12811","title":"A Multi-Power Law for Loss Curve Prediction Across Learning Rate Schedules","created":"2025-03-17","cited_by_count":22,"area":null},{"id":"2510.06826","title":"Mid-Training of Large Language Models: A Survey","created":"2025-10-08","cited_by_count":21,"area":null},{"id":"2105.03588","title":"Facial Emotion Recognition: State of the Art Performance on FER2013","created":"2021-05-08","cited_by_count":20,"area":null},{"id":"2106.15739","title":"On the Periodic Behavior of Neural Network Training with Batch Normalization and Weight Decay","created":"2021-06-29","cited_by_count":20,"area":null},{"id":"2510.19093","title":"Weight Decay may matter more than muP for Learning Rate Transfer in Practice","created":"2025-10-21","cited_by_count":20,"area":null},{"id":"2209.03695","title":"Training Scale-Invariant Neural Networks on the Sphere Can Happen in Three Regimes","created":"2022-09-08","cited_by_count":19,"area":null},{"id":"2403.19316","title":"Hypergraph-based Multi-View Action Recognition using Event Cameras","created":"2024-03-28","cited_by_count":19,"area":null},{"id":"2103.01338","title":"Acceleration via Fractal Learning Rate Schedules","created":"2021-03-01","cited_by_count":13,"area":null},{"id":"2210.15898","title":"Toward Equation of Motion for Deep Neural Networks: Continuous-time Gradient Descent and Discretization Error Analysis","created":"2022-10-28","cited_by_count":13,"area":null},{"id":"2402.13725","title":"Sparse and Structured Hopfield Networks","created":"2024-02-21","cited_by_count":13,"area":null},{"id":"2106.03743","title":"Proxy-Normalizing Activations to Match Batch Normalization while Removing Batch Dependence","created":"2021-06-07","cited_by_count":12,"area":null},{"id":"2206.10011","title":"When Does Re-initialization Work?","created":"2022-06-20","cited_by_count":12,"area":null},{"id":"2401.08734","title":"Bag of Tricks to Boost Adversarial Transferability","created":"2024-01-16","cited_by_count":12,"area":null},{"id":"2508.01483","title":"Training Dynamics of the Cooldown Stage in Warmup-Stable-Decay Learning Rate Scheduler","created":"2025-08-02","cited_by_count":12,"area":null},{"id":"2103.12682","title":"How to decay your learning rate","created":"2021-03-23","cited_by_count":11,"area":null},{"id":"2102.10094","title":"Formal Language Theory Meets Modern NLP","created":"2021-02-19","cited_by_count":9,"area":null},{"id":"2103.08745","title":"S3Net: 3D LiDAR Sparse Semantic Segmentation Network","created":"2021-03-15","cited_by_count":9,"area":null},{"id":"2310.11291","title":"An Automatic Learning Rate Schedule Algorithm for Achieving Faster Convergence and Steeper Descent","created":"2023-10-17","cited_by_count":9,"area":null},{"id":"2107.04197","title":"REX: Revisiting Budgeted Training with an Improved Schedule","created":"2021-07-09","cited_by_count":8,"area":null},{"id":"2203.01400","title":"Adaptive Gradient Methods with Local Guarantees","created":"2022-03-02","cited_by_count":8,"area":null},{"id":"2304.04386","title":"Generating Adversarial Attacks in the Latent Space","created":"2023-04-10","cited_by_count":8,"area":null},{"id":"2312.02151","title":"Guarding Barlow Twins Against Overfitting with Mixed Samples","created":"2023-12-04","cited_by_count":8,"area":null},{"id":"2408.10993","title":"Facial Demorphing via Identity Preserving Image Decomposition","created":"2024-08-20","cited_by_count":8,"area":null},{"id":"2502.01179","title":"Joint Localization and Activation Editing for Low-Resource Fine-Tuning","created":"2025-02-03","cited_by_count":8,"area":null},{"id":"2507.20057","title":"What Can Grokking Teach Us About Learning Under Nonstationarity?","created":"2025-07-26","cited_by_count":8,"area":null},{"id":"2510.15262","title":"Robust Layerwise Scaling Rules by Proper Weight Decay Tuning","created":"2025-10-17","cited_by_count":8,"area":null},{"id":"2303.15634","title":"Learning Rate Schedules in the Presence of Distribution Shift","created":"2023-03-27","cited_by_count":7,"area":null},{"id":"2305.16573","title":"Exploring Weight Balancing on Long-Tailed Recognition Problem","created":"2023-05-26","cited_by_count":7,"area":null},{"id":"2312.15681","title":"Partial Fine-Tuning: A Successor to Full Fine-Tuning for Vision Transformers","created":"2023-12-25","cited_by_count":7,"area":null},{"id":"2403.12486","title":"NTK-Guided Few-Shot Class Incremental Learning","created":"2024-03-19","cited_by_count":7,"area":null},{"id":"2405.05171","title":"Custom Gradient Estimators are Straight-Through Estimators in Disguise","created":"2024-05-08","cited_by_count":6,"area":null},{"id":"2305.15912","title":"Neural Characteristic Activation Analysis and Geometric Parameterization for ReLU Networks","created":"2023-05-25","cited_by_count":5,"area":null},{"id":"2409.18828","title":"MECG-E: Mamba-based ECG Enhancer for Baseline Wander Removal","created":"2024-09-27","cited_by_count":5,"area":null},{"id":"2101.02916","title":"Accelerating Training of Batch Normalization: A Manifold Perspective","created":"2021-01-08","cited_by_count":4,"area":null},{"id":"2306.00700","title":"On the Weight Dynamics of Deep Normalized Networks","created":"2023-06-01","cited_by_count":4,"area":null},{"id":"2309.05224","title":"SparseSwin: Swin Transformer with Sparse Transformer Block","created":"2023-09-11","cited_by_count":4,"area":null},{"id":"2410.11985","title":"The Fair Language Model Paradox","created":"2024-10-15","cited_by_count":4,"area":null},{"id":"2507.22524","title":"HGCN(O): A Self-Tuning GCN HyperModel Toolkit for Outcome Prediction in Event-Sequence Data","created":"2025-07-30","cited_by_count":4,"area":null},{"id":"2509.25049","title":"Efficient Hyperparameter Tuning via Trajectory Invariance Principle","created":"2025-09-29","cited_by_count":4,"area":null},{"id":"2103.15345","title":"FixNorm: Dissecting Weight Decay for Training Deep Neural Networks","created":"2021-03-29","cited_by_count":3,"area":null},{"id":"2209.12590","title":"Learning to Drop Out: An Adversarial Approach to Training Sequence VAEs","created":"2022-09-26","cited_by_count":3,"area":null},{"id":"2211.09562","title":"Convolutional neural networks for medical image segmentation","created":"2022-11-17","cited_by_count":3,"area":null},{"id":"2302.12444","title":"On the Training Instability of Shuffling SGD with Batch Normalization","created":"2023-02-24","cited_by_count":3,"area":null},{"id":"2404.06971","title":"TrajPRed: Trajectory Prediction with Region-based Relation Learning","created":"2024-04-10","cited_by_count":3,"area":null},{"id":"2411.14711","title":"Can GNNs Learn Link Heuristics? A Concise Review and Evaluation of Link Prediction Methods","created":"2024-11-22","cited_by_count":3,"area":null},{"id":"2607.06915","title":"Smart Scissor: Coupling Spatial Redundancy Reduction and CNN Compression for Embedded Hardware","created":"2026-07-08","cited_by_count":3,"area":null},{"id":"2608.24814","title":"Effective Learning Rate Governs Loss Dynamics in Language Model Pretraining","created":"2026-08-25","cited_by_count":3,"area":null},{"id":"2112.11018","title":"A Theoretical View of Linear Backpropagation and Its Convergence","created":"2021-12-21","cited_by_count":2,"area":null},{"id":"2205.11078","title":"Beyond EM Algorithm on Over-specified Two-Component Location-Scale Gaussian Mixtures","created":"2022-05-23","cited_by_count":2,"area":null},{"id":"2206.09040","title":"Energy reconstruction for large liquid scintillator detectors with machine learning techniques: aggregated features approach","created":"2022-06-17","cited_by_count":2,"area":null},{"id":"2310.14963","title":"Studying K-FAC Heuristics by Viewing Adam through a Second-Order Lens","created":"2023-10-23","cited_by_count":2,"area":null},{"id":"2407.04218","title":"Batch Transformer: Look for Attention in Batch","created":"2024-07-05","cited_by_count":2,"area":null},{"id":"2503.07926","title":"Learning Gentle Grasping Using Vision, Sound, and Touch","created":"2025-03-11","cited_by_count":2,"area":null},{"id":"2505.24005","title":"How far away are truly hyperparameter-free learning algorithms?","created":"2025-05-29","cited_by_count":2,"area":null},{"id":"2506.03515","title":"BitTTS: Highly Compact Text-to-Speech Using 1.58-bit Quantization and Weight Indexing","created":"2025-06-04","cited_by_count":2,"area":null},{"id":"2507.16571","title":"Data-Driven Adaptive Gradient Recovery for Unstructured Finite Volume Computations","created":"2025-07-22","cited_by_count":2,"area":null},{"id":"2507.23297","title":"Simulation-based inference for Precision Neutrino Physics through Neural Monte Carlo tuning","created":"2025-07-31","cited_by_count":2,"area":null},{"id":"2102.03497","title":"Weight Rescaling: Effective and Robust Regularization for Deep Neural Networks with Batch Normalization","created":"2021-02-06","cited_by_count":1,"area":null},{"id":"2205.07999","title":"An Exponentially Increasing Step-size for Parameter Estimation in Statistical Models","created":"2022-05-16","cited_by_count":1,"area":null},{"id":"2207.03264","title":"A Solver + Gradient Descent Training Algorithm for Deep Neural Networks","created":"2022-07-07","cited_by_count":1,"area":null},{"id":"2309.00347","title":"Towards Contrastive Learning in Music Video Domain","created":"2023-09-01","cited_by_count":1,"area":null},{"id":"2406.12901","title":"Interpretable machine learning approach for electron antineutrino selection in a large liquid scintillator detector","created":"2024-06-09","cited_by_count":1,"area":null},{"id":"2408.07815","title":"Algebraic Representations for Faster Predictions in Convolutional Neural Networks","created":"2024-08-14","cited_by_count":1,"area":null},{"id":"2409.12038","title":"A Unified Framework for Neural Computation and Learning Over Time","created":"2024-09-18","cited_by_count":1,"area":null},{"id":"2512.01231","title":"Implicitly Normalized Online PCA: A Regularized Algorithm with Exact High-Dimensional Dynamics","created":"2025-12-01","cited_by_count":1,"area":null},{"id":"2605.04418","title":"Demystifying Manifold Constraints in LLM Pre-training","created":"2026-05-06","cited_by_count":1,"area":null},{"id":"2606.19302","title":"Optimal scenario design for climate emulation","created":"2026-06-17","cited_by_count":1,"area":null},{"id":"2607.21005","title":"Weight-norm Criticality: A Mechanism for Loss Spikes Induced by the Normalization and Weight Decay","created":"2026-07-23","cited_by_count":1,"area":null},{"id":"2102.00853","title":"Painless step size adaptation for SGD","created":"2021-02-01","cited_by_count":0,"area":null},{"id":"2104.02578","title":"Neurons learn slower than they think","created":"2021-04-02","cited_by_count":0,"area":null},{"id":"2308.01604","title":"IndoHerb: Indonesia Medicinal Plants Recognition using Transfer Learning and Deep Learning","created":"2023-08-03","cited_by_count":0,"area":null},{"id":"2310.14671","title":"Scrap Your Schedules with PopDescent","created":"2023-10-23","cited_by_count":0,"area":null},{"id":"2402.19059","title":"WHU-Synthetic: A Synthetic Perception Dataset for 3-D Multitask Model Research","created":"2024-02-29","cited_by_count":0,"area":null},{"id":"2403.05532","title":"Twin: Tuning Learning Rate and Weight Decay of Deep Homogeneous Classifiers without Validation","created":"2024-03-08","cited_by_count":0,"area":null},{"id":"2407.18906","title":"A Scalable Quantum Non-local Neural Network for Image Classification","created":"2024-07-26","cited_by_count":0,"area":null},{"id":"2408.08766","title":"VF-NeRF: Learning Neural Vector Fields for Indoor Scene Reconstruction","created":"2024-08-16","cited_by_count":0,"area":null},{"id":"2411.02556","title":"Leveraging Transformer-Based Models for Predicting Inflection Classes of Words in an Endangered Sami Language","created":"2024-11-04","cited_by_count":0,"area":null},{"id":"2504.01875","title":"AYLA: Architecting a loss landscape in shallow neural networks to accelerate feature recovery","created":"2025-04-02","cited_by_count":0,"area":null},{"id":"2507.01724","title":"Revisiting Learning Rate Control","created":"2025-07-02","cited_by_count":0,"area":null},{"id":"2507.15970","title":"CIS-BWE: Chaos-Informed Speech Bandwidth Extension","created":"2025-07-21","cited_by_count":0,"area":null}],"next_cursor":"100"}