{"total":686,"rows":[{"id":"2502.07529","title":"Training Deep Learning Models with Norm-Constrained LMOs","created":"2025-02-11","cited_by_count":192,"area":null},{"id":"2101.12699","title":"Exploring Deep Neural Networks via Layer-Peeled Model: Minority Collapse in Imbalanced Training","created":"2021-01-29","cited_by_count":166,"area":null},{"id":"2110.03735","title":"Adversarial Unlearning of Backdoors via Implicit Hypergradient","created":"2021-10-07","cited_by_count":166,"area":null},{"id":"2302.02941","title":"On Over-Squashing in Message Passing Neural Networks: The Impact of Width, Depth, and Topology","created":"2023-02-06","cited_by_count":166,"area":null},{"id":"2106.02073","title":"Neural Collapse Under MSE Loss: Proximity to and Dynamics on the Central Path","created":"2021-06-03","cited_by_count":158,"area":null},{"id":"2106.04538","title":"What Makes Multi-modal Learning Better than Single (Provably)","created":"2021-06-08","cited_by_count":153,"area":null},{"id":"2105.12806","title":"A Universal Law of Robustness via Isoperimetry","created":"2021-05-26","cited_by_count":151,"area":null},{"id":"2201.04234","title":"Leveraging Unlabeled Data to Predict Out-of-Distribution Performance","created":"2022-01-11","cited_by_count":145,"area":null},{"id":"2110.10090","title":"Inductive Biases and Variable Creation in Self-Attention Mechanisms","created":"2021-10-19","cited_by_count":144,"area":null},{"id":"2305.19420","title":"What and How does In-Context Learning Learn? Bayesian Model Averaging, Parameterization, and Generalization","created":"2023-05-30","cited_by_count":118,"area":null},{"id":"2106.13799","title":"Assessing Generalization of SGD via Disagreement","created":"2021-06-25","cited_by_count":117,"area":null},{"id":"2104.07167","title":"Orthogonalizing Convolutional Layers with the Cayley Transform","created":"2021-04-14","cited_by_count":105,"area":null},{"id":"2110.02095","title":"Exploring the Limits of Large Scale Pre-training","created":"2021-10-05","cited_by_count":104,"area":null},{"id":"2107.13163","title":"Statistically Meaningful Approximation: a Case Study on Approximating Turing Machines with Transformers","created":"2021-07-28","cited_by_count":102,"area":null},{"id":"2112.15121","title":"On the Role of Neural Collapse in Transfer Learning","created":"2021-12-30","cited_by_count":100,"area":null},{"id":"2206.13089","title":"Agreement-on-the-Line: Predicting the Performance of Neural Networks under Distribution Shift","created":"2022-06-27","cited_by_count":94,"area":null},{"id":"2202.06526","title":"Benign Overfitting in Two-layer Convolutional Neural Networks","created":"2022-02-14","cited_by_count":91,"area":null},{"id":"2208.12591","title":"On the Implicit Bias in Deep-Learning Algorithms","created":"2022-08-26","cited_by_count":86,"area":null},{"id":"2205.06908","title":"Neural-Fly Enables Rapid Learning for Agile Flight in Strong Winds","created":"2022-05-13","cited_by_count":85,"area":null},{"id":"2102.00931","title":"Information-Theoretic Generalization Bounds for Stochastic Gradient Descent","created":"2021-02-01","cited_by_count":84,"area":null},{"id":"2110.13905","title":"Gradient Descent on Two-layer Nets: Margin Maximization and Simplicity Bias","created":"2021-10-26","cited_by_count":83,"area":null},{"id":"2405.00254","title":"RLHF from Heterogeneous Feedback via Personalization and Preference Aggregation","created":"2024-04-30","cited_by_count":74,"area":"alignment"},{"id":"2102.01063","title":"Zen-NAS: A Zero-Shot NAS for High-Performance Deep Image Recognition","created":"2021-02-01","cited_by_count":73,"area":null},{"id":"2207.09238","title":"Formal Algorithms for Transformers","created":"2022-07-19","cited_by_count":72,"area":null},{"id":"2304.05055","title":"A Comprehensive Survey on Deep Graph Representation Learning","created":"2023-04-11","cited_by_count":72,"area":null},{"id":"2105.11417","title":"Skew Orthogonal Convolutions","created":"2021-05-24","cited_by_count":67,"area":null},{"id":"2103.05127","title":"Model Complexity of Deep Learning: A Survey","created":"2021-03-08","cited_by_count":65,"area":null},{"id":"2107.08444","title":"A Theory of PAC Learnability of Partial Concept Classes","created":"2021-07-18","cited_by_count":60,"area":null},{"id":"2110.12690","title":"A Dynamical System Perspective for Lipschitz Neural Networks","created":"2021-10-25","cited_by_count":60,"area":null},{"id":"2109.09444","title":"When Do Extended Physics-Informed Neural Networks (XPINNs) Improve Generalization?","created":"2021-09-20","cited_by_count":58,"area":null},{"id":"2109.02355","title":"A Farewell to the Bias-Variance Tradeoff? An Overview of the Theory of Overparameterized Machine Learning","created":"2021-09-06","cited_by_count":57,"area":null},{"id":"2106.01606","title":"Exploring Memorization in Adversarial Training","created":"2021-06-03","cited_by_count":55,"area":null},{"id":"2306.03589","title":"How does over-squashing affect the power of GNNs?","created":"2023-06-06","cited_by_count":53,"area":null},{"id":"2106.16225","title":"Analytic Insights into Structure and Rank of Neural Network Hessian Maps","created":"2021-06-30","cited_by_count":52,"area":null},{"id":"2107.12636","title":"Exploring Sequence Feature Alignment for Domain Adaptive Detection Transformers","created":"2021-07-27","cited_by_count":49,"area":null},{"id":"2402.11867","title":"LoRA Training in the NTK Regime has No Spurious Local Minima","created":"2024-02-19","cited_by_count":48,"area":null},{"id":"2108.04062","title":"Improved deterministic l2 robustness on CIFAR-10 and CIFAR-100","created":"2021-08-05","cited_by_count":47,"area":null},{"id":"2104.05942","title":"Recurrent Equilibrium Networks: Flexible Dynamic Models with Guaranteed Stability and Robustness","created":"2021-04-13","cited_by_count":45,"area":null},{"id":"2110.00675","title":"Contraction Theory for Nonlinear Stability Analysis and Learning-based Control: A Tutorial Overview","created":"2021-10-01","cited_by_count":45,"area":null},{"id":"2111.04578","title":"Improved Regularization and Robustness for Fine-tuning in Neural Networks","created":"2021-11-08","cited_by_count":45,"area":null},{"id":"2210.07394","title":"Efficiently Computing Local Lipschitz Constants of Neural Networks via Bound Propagation","created":"2022-10-13","cited_by_count":45,"area":null},{"id":"2211.08939","title":"Augmented Physics-Informed Neural Networks (APINNs): A gating network-based soft domain decomposition methodology","created":"2022-11-16","cited_by_count":44,"area":null},{"id":"2312.14820","title":"How Smooth Is Attention?","created":"2023-12-22","cited_by_count":44,"area":null},{"id":"2305.11788","title":"Implicit Bias of Gradient Descent for Logistic Regression at the Edge of Stability","created":"2023-05-19","cited_by_count":42,"area":null},{"id":"2106.04546","title":"LEADS: Learning Dynamical Systems that Generalize Across Environments","created":"2021-06-08","cited_by_count":40,"area":null},{"id":"2302.04451","title":"Generalization in Graph Neural Networks: Improved PAC-Bayesian Bounds on Graph Diffusion","created":"2023-02-09","cited_by_count":40,"area":null},{"id":"2103.15209","title":"Understanding the role of importance weighting for deep learning","created":"2021-03-28","cited_by_count":39,"area":null},{"id":"2110.15767","title":"Adversarial Robustness with Semi-Infinite Constrained Learning","created":"2021-10-29","cited_by_count":39,"area":null},{"id":"2209.13083","title":"Why neural networks find simple solutions: the many regularizers of geometric complexity","created":"2022-09-27","cited_by_count":39,"area":null},{"id":"2210.06443","title":"On the Effectiveness of Lipschitz-Driven Rehearsal in Continual Learning","created":"2022-10-12","cited_by_count":39,"area":null},{"id":"2211.16327","title":"On the Power of Foundation Models","created":"2022-11-29","cited_by_count":37,"area":null},{"id":"2104.05641","title":"Generalization bounds via distillation","created":"2021-04-12","cited_by_count":34,"area":null},{"id":"2106.05932","title":"Early-stopped neural networks are consistent","created":"2021-06-10","cited_by_count":34,"area":null},{"id":"2206.02659","title":"Robust Fine-Tuning of Deep Neural Networks with Hessian-based Generalization Guarantees","created":"2022-06-06","cited_by_count":34,"area":null},{"id":"2303.04145","title":"Benign Overfitting for Two-layer ReLU Convolutional Neural Networks","created":"2023-03-07","cited_by_count":34,"area":null},{"id":"2102.05274","title":"Stability of SGD: Tightness Analysis and Improved Bounds","created":"2021-02-10","cited_by_count":33,"area":null},{"id":"2107.00595","title":"Fast Margin Maximization via Dual Acceleration","created":"2021-07-01","cited_by_count":33,"area":null},{"id":"2209.06053","title":"Towards Understanding the Overfitting Phenomenon of Deep Click-Through Rate Prediction Models","created":"2022-09-04","cited_by_count":33,"area":null},{"id":"2305.15614","title":"Reverse Engineering Self-Supervised Learning","created":"2023-05-24","cited_by_count":33,"area":null},{"id":"2310.02579","title":"On the Stability of Expressive Positional Encodings for Graphs","created":"2023-10-04","cited_by_count":33,"area":null},{"id":"2301.11509","title":"Out-of-distributional risk bounds for neural operators with applications to the Helmholtz equation","created":"2023-01-27","cited_by_count":32,"area":null},{"id":"2110.03128","title":"On the Generalization of Models Trained with SGD: Information-Theoretic Bounds and Implications","created":"2021-10-07","cited_by_count":31,"area":null},{"id":"2509.12235","title":"RL Fine-Tuning Heals OOD Forgetting in SFT","created":"2025-09-08","cited_by_count":31,"area":"lr"},{"id":"2102.06589","title":"Generalization Bounds for Meta-Learning via PAC-Bayes and Uniform Stability","created":"2021-02-12","cited_by_count":30,"area":null},{"id":"2104.05097","title":"Pay attention to your loss: understanding misconceptions about 1-Lipschitz neural networks","created":"2021-04-11","cited_by_count":30,"area":null},{"id":"2107.04835","title":"Noise Stability Regularization for Improving BERT Fine-tuning","created":"2021-07-10","cited_by_count":29,"area":null},{"id":"2310.12972","title":"CCIL: Continuity-based Data Augmentation for Corrective Imitation Learning","created":"2023-10-19","cited_by_count":29,"area":"offlinerl"},{"id":"2310.13088","title":"Sequence Length Independent Norm-Based Generalization Bounds for Transformers","created":"2023-10-19","cited_by_count":29,"area":null},{"id":"2302.08933","title":"Universality laws for Gaussian mixtures in generalized linear models","created":"2023-02-17","cited_by_count":28,"area":null},{"id":"2108.00781","title":"Generalization Bounds using Lower Tail Exponents in Stochastic Optimizers","created":"2021-08-02","cited_by_count":27,"area":null},{"id":"2309.16314","title":"A Primer on Bayesian Neural Networks: Review and Debates","created":"2023-09-28","cited_by_count":27,"area":null},{"id":"2205.12808","title":"Mirror Descent Maximizes Generalized Margin and Can Be Implemented Efficiently","created":"2022-05-25","cited_by_count":26,"area":null},{"id":"2302.10886","title":"Some Fundamental Aspects about Lipschitz Continuity of Neural Networks","created":"2023-02-21","cited_by_count":26,"area":null},{"id":"2101.06154","title":"On the statistical complexity of quantum circuits","created":"2021-01-15","cited_by_count":25,"area":null},{"id":"2106.03314","title":"Measuring Generalization with Optimal Transport","created":"2021-06-07","cited_by_count":25,"area":null},{"id":"2203.10036","title":"On the Generalization Mystery in Deep Learning","created":"2022-03-18","cited_by_count":25,"area":null},{"id":"2303.00633","title":"An Information-Theoretic Perspective on Variance-Invariance-Covariance Regularization","created":"2023-03-01","cited_by_count":25,"area":null},{"id":"2305.17476","title":"Toward Understanding Generative Data Augmentation","created":"2023-05-27","cited_by_count":25,"area":null},{"id":"2210.16222","title":"Improving Lipschitz-Constrained Neural Networks by Learning Activation Functions","created":"2022-10-28","cited_by_count":24,"area":null},{"id":"2110.09246","title":"Single Layer Predictive Normalized Maximum Likelihood for Out-of-Distribution Detection","created":"2021-10-18","cited_by_count":23,"area":null},{"id":"2111.05529","title":"Understanding the Generalization Benefit of Model Invariance from a Data Perspective","created":"2021-11-10","cited_by_count":22,"area":null},{"id":"2201.09418","title":"Approximation bounds for norm constrained neural networks with applications to regression and GANs","created":"2022-01-24","cited_by_count":22,"area":null},{"id":"2202.01627","title":"Non-Vacuous Generalisation Bounds for Shallow Neural Networks","created":"2022-02-03","cited_by_count":22,"area":null},{"id":"2510.23012","title":"Softmax is $1/2$-Lipschitz: A tight bound across all $\\ell_p$ norms","created":"2025-10-27","cited_by_count":22,"area":null},{"id":"2209.09298","title":"Stability and Generalization Analysis of Gradient Methods for Shallow Neural Networks","created":"2022-09-19","cited_by_count":21,"area":null},{"id":"2305.06648","title":"Generalization bounds for neural ordinary differential equations and deep residual networks","created":"2023-05-11","cited_by_count":21,"area":null},{"id":"2306.05706","title":"Understanding How Consistency Works in Federated Learning via Stage-wise Relaxed Initialization","created":"2023-06-09","cited_by_count":21,"area":null},{"id":"2311.11871","title":"Training robust and generalizable quantum models","created":"2023-11-20","cited_by_count":21,"area":null},{"id":"2405.03676","title":"Why is SAM Robust to Label Noise?","created":"2024-05-06","cited_by_count":21,"area":null},{"id":"2105.00303","title":"RATT: Leveraging Unlabeled Data to Guarantee Generalization","created":"2021-05-01","cited_by_count":20,"area":null},{"id":"2109.00267","title":"The Impact of Reinitialization on Generalization in Convolutional Neural Networks","created":"2021-09-01","cited_by_count":20,"area":null},{"id":"2111.14932","title":"Learning with Noisy Labels by Efficient Transition Matrix Estimation to Combat Label Miscorrection","created":"2021-11-29","cited_by_count":20,"area":null},{"id":"2202.11455","title":"On PAC-Bayesian reconstruction guarantees for VAEs","created":"2022-02-23","cited_by_count":20,"area":null},{"id":"2303.14582","title":"Identification of Negative Transfers in Multitask Learning Using Surrogate Models","created":"2023-03-25","cited_by_count":20,"area":null},{"id":"2306.00788","title":"Understanding Augmentation-based Self-Supervised Representation Learning via RKHS Approximation and Regression","created":"2023-06-01","cited_by_count":20,"area":null},{"id":"2309.01213","title":"Implicit regularization of deep residual networks towards neural ODEs","created":"2023-09-03","cited_by_count":20,"area":null},{"id":"2312.00359","title":"Temperature Balancing, Layer-wise Weight Analysis, and Neural Network Training","created":"2023-12-01","cited_by_count":20,"area":null},{"id":"2507.13338","title":"Training Transformers with Enforced Lipschitz Constants","created":"2025-07-17","cited_by_count":20,"area":null},{"id":"2104.05508","title":"Noether: The More Things Change, the More Stay the Same","created":"2021-04-12","cited_by_count":19,"area":null},{"id":"2106.00734","title":"Post-mortem on a deep learning contest: a Simpson's paradox and the complementary roles of scale metrics versus shape metrics","created":"2021-06-01","cited_by_count":19,"area":null}],"next_cursor":"100"}