{"total":226,"rows":[{"id":"2209.04836","title":"Git Re-Basin: Merging Models modulo Permutation Symmetries","created":"2022-09-11","cited_by_count":471,"area":null},{"id":"2102.06810","title":"Understanding self-supervised Learning Dynamics without Contrastive Pairs","created":"2021-02-12","cited_by_count":256,"area":null},{"id":"2105.02375","title":"A Geometric Analysis of Neural Collapse with Unconstrained Features","created":"2021-05-06","cited_by_count":227,"area":null},{"id":"2302.02941","title":"On Over-Squashing in Message Passing Neural Networks: The Impact of Width, Depth, and Topology","created":"2023-02-06","cited_by_count":166,"area":null},{"id":"2202.08087","title":"Extended Unconstrained Features Model for Exploring Deep Neural Collapse","created":"2022-02-16","cited_by_count":102,"area":null},{"id":"2103.00502","title":"Optimal Approximation Rate of ReLU Networks in terms of Width and Depth","created":"2021-02-28","cited_by_count":96,"area":null},{"id":"2206.04041","title":"Neural Collapse: A Review on Modelling Principles and Generalization","created":"2022-06-08","cited_by_count":95,"area":null},{"id":"2309.15698","title":"Deep Model Fusion: A Survey","created":"2023-09-27","cited_by_count":91,"area":null},{"id":"2111.05803","title":"Gradients are Not All You Need","created":"2021-11-10","cited_by_count":86,"area":null},{"id":"2106.15933","title":"Saddle-to-Saddle Dynamics in Deep Linear Networks: Small Initialization Training, Symmetry, and Sparsity","created":"2021-06-30","cited_by_count":85,"area":null},{"id":"2307.12306","title":"Tackling the Curse of Dimensionality with Physics-Informed Neural Networks","created":"2023-07-23","cited_by_count":79,"area":null},{"id":"2109.09444","title":"When Do Extended Physics-Informed Neural Networks (XPINNs) Improve Generalization?","created":"2021-09-20","cited_by_count":58,"area":null},{"id":"2304.00488","title":"Saddle-to-Saddle Dynamics in Diagonal Linear Networks","created":"2023-04-02","cited_by_count":57,"area":null},{"id":"2105.04550","title":"Optimization of Graph Neural Networks: Implicit Acceleration by Skip Connections and More Depth","created":"2021-05-10","cited_by_count":55,"area":null},{"id":"2106.16225","title":"Analytic Insights into Structure and Rank of Neural Network Hessian Maps","created":"2021-06-30","cited_by_count":52,"area":null},{"id":"2211.08422","title":"Mechanistic Mode Connectivity","created":"2022-11-15","cited_by_count":50,"area":null},{"id":"2202.07508","title":"Deep Constrained Least Squares for Blind Image Super-Resolution","created":"2022-02-15","cited_by_count":47,"area":null},{"id":"2106.14568","title":"Deep Ensembling with No Overhead for either Training or Testing: The All-Round Blessings of Dynamic Sparsity","created":"2021-06-28","cited_by_count":44,"area":null},{"id":"2211.08939","title":"Augmented Physics-Informed Neural Networks (APINNs): A gating network-based soft domain decomposition methodology","created":"2022-11-16","cited_by_count":44,"area":null},{"id":"2501.16371","title":"Optimizing the Optimizer for Physics-Informed Neural Networks and Kolmogorov-Arnold Networks","created":"2025-01-22","cited_by_count":42,"area":null},{"id":"2107.02397","title":"Deep Network Approximation: Achieving Arbitrary Accuracy with Fixed Number of Neurons","created":"2021-07-06","cited_by_count":41,"area":null},{"id":"2301.00437","title":"Neural Collapse in Deep Linear Networks: From Balanced to Imbalanced Data","created":"2023-01-01","cited_by_count":40,"area":null},{"id":"2201.08025","title":"Low-Pass Filtering SGD for Recovering Flat Optima in the Deep Learning Optimization Landscape","created":"2022-01-20","cited_by_count":39,"area":null},{"id":"2102.07346","title":"On the Theory of Implicit Deep Learning: Global Convergence with Implicit Layers","created":"2021-02-15","cited_by_count":35,"area":null},{"id":"2201.12680","title":"Understanding Deep Contrastive Learning via Coordinate-wise Optimization","created":"2022-01-29","cited_by_count":35,"area":null},{"id":"2103.01519","title":"Hessian Eigenspectra of More Realistic Nonlinear Models","created":"2021-03-02","cited_by_count":33,"area":null},{"id":"2201.11968","title":"Training invariances and the low-rank phenomenon: beyond linear networks","created":"2022-01-28","cited_by_count":33,"area":null},{"id":"2108.01538","title":"Geometry of Linear Convolutional Networks","created":"2021-08-03","cited_by_count":27,"area":null},{"id":"2312.15010","title":"SI-MIL: Taming Deep MIL for Self-Interpretability in Gigapixel Histopathology","created":"2023-12-22","cited_by_count":25,"area":null},{"id":"2105.14417","title":"Overparameterization of deep ResNet: zero loss and mean-field analysis","created":"2021-05-30","cited_by_count":24,"area":null},{"id":"2107.13289","title":"The loss landscape of deep linear neural networks: a second-order analysis","created":"2021-07-28","cited_by_count":24,"area":null},{"id":"2202.04777","title":"Exact Solutions of a Deep Linear Network","created":"2022-02-10","cited_by_count":24,"area":null},{"id":"2211.02254","title":"How Does Adaptive Optimization Impact Local Neural Network Geometry?","created":"2022-11-04","cited_by_count":24,"area":null},{"id":"2110.04947","title":"Towards Demystifying Representation Learning with Non-contrastive Self-supervision","created":"2021-10-11","cited_by_count":23,"area":null},{"id":"2312.14499","title":"Hutchinson Trace Estimation for High-Dimensional and High-Order Physics-Informed Neural Networks","created":"2023-12-22","cited_by_count":23,"area":null},{"id":"2108.02040","title":"Convergence of gradient descent for learning linear neural networks","created":"2021-08-04","cited_by_count":22,"area":null},{"id":"2110.02479","title":"Exponentially Many Local Minima in Quantum Neural Networks","created":"2021-10-06","cited_by_count":22,"area":null},{"id":"2202.08788","title":"Global Convergence of Sub-gradient Method for Robust Matrix Recovery: Small Initialization, Noisy Measurements, and Over-parameterization","created":"2022-02-17","cited_by_count":21,"area":null},{"id":"2212.14457","title":"Bayesian Interpolation with Deep Linear Networks","created":"2022-12-29","cited_by_count":21,"area":null},{"id":"2106.10785","title":"Adversarial Attack on Graph Neural Networks as An Influence Maximization Problem","created":"2021-06-21","cited_by_count":20,"area":null},{"id":"2306.00788","title":"Understanding Augmentation-based Self-Supervised Representation Learning via RKHS Approximation and Regression","created":"2023-06-01","cited_by_count":20,"area":null},{"id":"2306.01154","title":"The Law of Parsimony in Gradient Descent for Learning Deep Linear Networks","created":"2023-06-01","cited_by_count":20,"area":null},{"id":"2206.01342","title":"Understanding the Role of Nonlinearity in Training Dynamics of Contrastive Learning","created":"2022-06-02","cited_by_count":19,"area":null},{"id":"2210.00638","title":"What shapes the loss landscape of self-supervised learning?","created":"2022-10-02","cited_by_count":19,"area":null},{"id":"2304.05752","title":"Function Space and Critical Points of Linear Convolutional Networks","created":"2023-04-12","cited_by_count":19,"area":null},{"id":"2311.15283","title":"Bias-Variance Trade-off in Physics-Informed Neural Networks with Randomized Smoothing for High-Dimensional PDEs","created":"2023-11-26","cited_by_count":19,"area":null},{"id":"2402.07193","title":"Parameter Symmetry and Noise Equilibrium of Stochastic Gradient Descent","created":"2024-02-11","cited_by_count":19,"area":null},{"id":"2505.24749","title":"SUMO: Subspace-Aware Moment-Orthogonalization for Accelerating Memory-Efficient LLM Training","created":"2025-05-30","cited_by_count":19,"area":null},{"id":"2205.04009","title":"Posterior Collapse of a Linear Latent Variable Model","created":"2022-05-09","cited_by_count":18,"area":null},{"id":"2410.17881","title":"AdaRankGrad: Adaptive Gradient-Rank and Moments for Memory-Efficient LLMs Training and Fine-Tuning","created":"2024-10-23","cited_by_count":17,"area":null},{"id":"2403.00986","title":"Merging Text Transformer Models from Different Initializations","created":"2024-03-01","cited_by_count":16,"area":null},{"id":"2102.12430","title":"Noisy Gradient Descent Converges to Flat Minima for Nonconvex Matrix Factorization","created":"2021-02-24","cited_by_count":15,"area":null},{"id":"2512.20607","title":"Saddle-to-Saddle Dynamics Explains A Simplicity Bias Across Neural Network Architectures","created":"2025-12-23","cited_by_count":15,"area":null},{"id":"2105.10762","title":"AutoLRS: Automatic Learning-Rate Schedule by Bayesian Optimization on the Fly","created":"2021-05-22","cited_by_count":14,"area":null},{"id":"2408.04569","title":"Activation degree thresholds and expressiveness of polynomial neural networks","created":"2024-08-08","cited_by_count":14,"area":null},{"id":"2507.02550","title":"Position: A Theory of Deep Learning Must Include Compositional Sparsity","created":"2025-07-03","cited_by_count":14,"area":null},{"id":"2102.06329","title":"Stragglers Are Not Disaster: A Hybrid Federated Learning Algorithm with Delayed Gradients","created":"2021-02-12","cited_by_count":13,"area":null},{"id":"2204.10782","title":"On Feature Learning in Neural Networks with Global Convergence Guarantees","created":"2022-04-22","cited_by_count":13,"area":null},{"id":"2410.23169","title":"The Persistence of Neural Collapse Despite Low-Rank Bias","created":"2024-10-30","cited_by_count":13,"area":null},{"id":"2110.02926","title":"On the Global Convergence of Gradient Descent for multi-layer ResNets in the mean-field regime","created":"2021-10-06","cited_by_count":12,"area":null},{"id":"2111.07964","title":"Deep Network Approximation in Terms of Intrinsic Parameters","created":"2021-11-15","cited_by_count":12,"area":null},{"id":"2102.09671","title":"When Are Solutions Connected in Deep Networks?","created":"2021-02-18","cited_by_count":11,"area":null},{"id":"2103.10922","title":"Landscape analysis for shallow neural networks: complete classification of critical points for affine target functions","created":"2021-03-19","cited_by_count":11,"area":null},{"id":"2106.14836","title":"Understanding Dynamics of Nonlinear Representation Learning and Its Application","created":"2021-06-28","cited_by_count":11,"area":null},{"id":"2205.15235","title":"Non-convex online learning via algorithmic equivalence","created":"2022-05-30","cited_by_count":11,"area":null},{"id":"2210.06788","title":"TiDAL: Learning Training Dynamics for Active Learning","created":"2022-10-13","cited_by_count":11,"area":null},{"id":"2302.01952","title":"On a continuous time model of gradient descent dynamics and instability in deep learning","created":"2023-02-03","cited_by_count":11,"area":null},{"id":"2402.17722","title":"Taming Nonconvex Stochastic Mirror Descent with General Bregman Divergence","created":"2024-02-27","cited_by_count":11,"area":null},{"id":"2604.05230","title":"Curvature-Aware Optimization for High-Accuracy Physics-Informed Neural Networks","created":"2026-04-06","cited_by_count":11,"area":null},{"id":"2105.05553","title":"Principal Components Bias in Over-parameterized Linear Models, and its Manifestation in Deep Neural Networks","created":"2021-05-12","cited_by_count":10,"area":null},{"id":"2112.11989","title":"FedLGA: Towards System-Heterogeneity of Federated Learning via Local Gradient Approximation","created":"2021-12-22","cited_by_count":10,"area":null},{"id":"2306.17378","title":"Global Optimality in Bivariate Gradient-based DAG Learning","created":"2023-06-30","cited_by_count":10,"area":null},{"id":"2401.16613","title":"Algebraic Complexity and Neurovariety of Linear Convolutional Networks","created":"2024-01-29","cited_by_count":10,"area":null},{"id":"2402.09142","title":"When Representations Align: Universality in Representation Learning Dynamics","created":"2024-02-14","cited_by_count":10,"area":null},{"id":"2408.11979","title":"Only Strict Saddles in the Energy Landscape of Predictive Coding Networks?","created":"2024-08-21","cited_by_count":10,"area":null},{"id":"2412.06289","title":"S$^{2}$FT: Efficient, Scalable and Generalizable LLM Fine-tuning by Structured Sparsity","created":"2024-12-09","cited_by_count":10,"area":null},{"id":"2104.03114","title":"Learning Residue-Aware Correlation Filters and Refining Scale Estimates with the GrabCut for Real-Time UAV Tracking","created":"2021-04-07","cited_by_count":9,"area":null},{"id":"2107.09194","title":"Can we globally optimize cross-validation loss? Quasiconvexity in ridge regression","created":"2021-07-19","cited_by_count":9,"area":null},{"id":"2404.06391","title":"Exploring Neural Network Landscapes: Star-Shaped and Geodesic Connectivity","created":"2024-04-09","cited_by_count":9,"area":null},{"id":"2101.08576","title":"A Note on Connectivity of Sublevel Sets in Deep Learning","created":"2021-01-21","cited_by_count":8,"area":null},{"id":"2103.13462","title":"Why Do Local Methods Solve Nonconvex Problems?","created":"2021-03-24","cited_by_count":8,"area":null},{"id":"2104.05785","title":"A Recipe for Global Convergence Guarantee in Deep Neural Networks","created":"2021-04-12","cited_by_count":8,"area":null},{"id":"2110.05960","title":"Imitating Deep Learning Dynamics via Locally Elastic Stochastic Differential Equations","created":"2021-10-11","cited_by_count":8,"area":null},{"id":"2202.12262","title":"On the Omnipresence of Spurious Local Minima in Certain Neural Network Training Problems","created":"2022-02-23","cited_by_count":8,"area":null},{"id":"2209.09315","title":"Deep Linear Networks can Benignly Overfit when Shallow Ones Do","created":"2022-09-19","cited_by_count":8,"area":null},{"id":"2210.12001","title":"When Expressivity Meets Trainability: Fewer than $n$ Neurons Can Work","created":"2022-10-21","cited_by_count":8,"area":null},{"id":"2311.02374","title":"Riemannian stochastic optimization methods avoid strict saddle points","created":"2023-11-04","cited_by_count":8,"area":null},{"id":"2102.13233","title":"Spurious Local Minima Are Common for Deep Neural Networks with Piecewise Linear Activations","created":"2021-02-25","cited_by_count":7,"area":null},{"id":"2206.00257","title":"CoNSoLe: Convex Neural Symbolic Learning","created":"2022-06-01","cited_by_count":7,"area":null},{"id":"2206.01515","title":"Understanding Deep Learning via Decision Boundary","created":"2022-06-03","cited_by_count":7,"area":null},{"id":"2206.09149","title":"Piecewise Linear Neural Networks and Deep Learning","created":"2022-06-18","cited_by_count":7,"area":null},{"id":"2207.01269","title":"DiffML: End-to-end Differentiable ML Pipelines","created":"2022-07-04","cited_by_count":7,"area":null},{"id":"2303.03027","title":"Critical Points and Convergence Analysis of Generative Deep Linear Networks Trained with Bures-Wasserstein Loss","created":"2023-03-06","cited_by_count":7,"area":null},{"id":"2306.05023","title":"Beyond Vanilla Variational Autoencoders: Detecting Posterior Collapse in Conditional and Hierarchical Variational Autoencoders","created":"2023-06-08","cited_by_count":7,"area":null},{"id":"2103.06875","title":"For Manifold Learning, Deep Neural Networks can be Locality Sensitive Hash Functions","created":"2021-03-11","cited_by_count":6,"area":null},{"id":"2111.05496","title":"ResNEsts and DenseNEsts: Block-based DNN Models with Improved Representation Guarantees","created":"2021-11-10","cited_by_count":6,"area":null},{"id":"2203.00614","title":"Side Effects of Learning from Low-dimensional Data Embedded in a Euclidean Space","created":"2022-03-01","cited_by_count":6,"area":null},{"id":"2205.12510","title":"Exact Phase Transitions in Deep Learning","created":"2022-05-25","cited_by_count":6,"area":null},{"id":"2210.01496","title":"Zeroth-Order Negative Curvature Finding: Escaping Saddle Points without Gradients","created":"2022-10-04","cited_by_count":6,"area":null},{"id":"2310.06159","title":"Provably Accelerating Ill-Conditioned Low-rank Estimation via Scaled Gradient Descent, Even with Overparameterization","created":"2023-10-09","cited_by_count":6,"area":null}],"next_cursor":"100"}