{"total":120,"rows":[{"id":"2103.03606","title":"Unbalanced minibatch Optimal Transport; applications to Domain Adaptation","created":"2021-03-05","cited_by_count":125,"area":null},{"id":"2210.15651","title":"Learning Single-Index Models with Shallow Neural Networks","created":"2022-10-27","cited_by_count":92,"area":null},{"id":"2110.13905","title":"Gradient Descent on Two-layer Nets: Margin Maximization and Simplicity Bias","created":"2021-10-26","cited_by_count":83,"area":null},{"id":"2101.01792","title":"Minibatch optimal transport distances; analysis and applications","created":"2021-01-05","cited_by_count":65,"area":null},{"id":"2106.04350","title":"Nonsmooth Implicit Differentiation for Machine Learning and Optimization","created":"2021-06-08","cited_by_count":43,"area":null},{"id":"2209.05045","title":"Gradient-Free Methods for Deterministic and Stochastic Nonsmooth Nonconvex Optimization","created":"2022-09-12","cited_by_count":43,"area":null},{"id":"2104.06763","title":"Oracle Complexity in Nonsmooth Nonconvex Optimization","created":"2021-04-14","cited_by_count":39,"area":null},{"id":"2107.06608","title":"Continuous vs. Discrete Optimization of Deep Neural Networks","created":"2021-07-14","cited_by_count":34,"area":null},{"id":"2201.11968","title":"Training invariances and the low-rank phenomenon: beyond linear networks","created":"2022-01-28","cited_by_count":33,"area":null},{"id":"2302.08300","title":"Deterministic Nonsmooth Nonconvex Optimization","created":"2023-02-16","cited_by_count":26,"area":null},{"id":"2210.03820","title":"The Asymmetric Maximum Margin Bias of Quasi-Homogeneous Neural Networks","created":"2022-10-07","cited_by_count":25,"area":null},{"id":"2405.18199","title":"Adam with model exponential moving average is effective for nonconvex optimization","created":"2024-05-28","cited_by_count":23,"area":null},{"id":"2106.13015","title":"A Stochastic Sequential Quadratic Optimization Algorithm for Nonlinear Equality Constrained Optimization with Rank-Deficient Jacobians","created":"2021-06-24","cited_by_count":22,"area":null},{"id":"2108.02040","title":"Convergence of gradient descent for learning linear neural networks","created":"2021-08-04","cited_by_count":22,"area":null},{"id":"2305.03938","title":"Adam-family Methods for Nonsmooth Optimization with Convergence Guarantees","created":"2023-05-06","cited_by_count":22,"area":null},{"id":"2101.02533","title":"Towards Understanding Learning in Neural Networks with Linear Teachers","created":"2021-01-07","cited_by_count":19,"area":null},{"id":"2410.22069","title":"Flavors of Margin: Implicit Bias of Steepest Descent in Homogeneous Neural Networks","created":"2024-10-29","cited_by_count":18,"area":null},{"id":"2306.06479","title":"Learning a Neuron by a Shallow ReLU Network: Dynamics and Implicit Bias for Correlated Inputs","created":"2023-06-10","cited_by_count":16,"area":null},{"id":"2301.06632","title":"Asymptotic normality and optimality in nonsmooth stochastic approximation","created":"2023-01-16","cited_by_count":14,"area":null},{"id":"2206.03907","title":"A Unified Convergence Theorem for Stochastic Optimization Methods","created":"2022-06-08","cited_by_count":12,"area":null},{"id":"2106.07613","title":"Improving Metric Dimensionality Reduction with Distributed Topology","created":"2021-06-14","cited_by_count":11,"area":null},{"id":"2108.11832","title":"Active manifolds, stratifications, and convergence to local minima in nonsmooth optimization","created":"2021-08-26","cited_by_count":11,"area":null},{"id":"2402.09226","title":"Directional Convergence Near Small Initializations and Saddles in Two-Homogeneous Neural Networks","created":"2024-02-14","cited_by_count":11,"area":null},{"id":"2602.16340","title":"The Implicit Bias of Adam and Muon on Smooth Homogeneous Neural Networks","created":"2026-02-18","cited_by_count":11,"area":null},{"id":"2206.03466","title":"Adversarial Reprogramming Revisited","created":"2022-06-07","cited_by_count":10,"area":null},{"id":"2302.11147","title":"Stochastic Approximation Beyond Gradient for Signal Processing and Machine Learning","created":"2023-02-22","cited_by_count":10,"area":null},{"id":"2108.02072","title":"Stochastic Subgradient Descent Escapes Active Strict Saddles on Weakly Convex Functions","created":"2021-08-04","cited_by_count":9,"area":null},{"id":"2203.15797","title":"Convergence of First-Order Methods for Constrained Nonconvex Optimization with Dependent Data","created":"2022-03-29","cited_by_count":7,"area":null},{"id":"2209.08745","title":"Importance Tempering: Group Robustness for Overparameterized Models","created":"2022-09-19","cited_by_count":6,"area":null},{"id":"2212.01314","title":"On Solution Functions of Optimization: Universal Approximation and Covering Number Bounds","created":"2022-12-02","cited_by_count":6,"area":null},{"id":"2302.14690","title":"On the existence of minimizers in shallow residual ReLU neural network optimization landscapes","created":"2023-02-28","cited_by_count":6,"area":null},{"id":"2402.05626","title":"Loss Landscape of Shallow ReLU-like Neural Networks: Stationary Points, Saddle Escape, and Network Embedding","created":"2024-02-08","cited_by_count":6,"area":null},{"id":"2505.01353","title":"Differentiable Nonlinear Model Predictive Control","created":"2025-05-02","cited_by_count":6,"area":null},{"id":"2510.08757","title":"LOTION: Smoothing the Optimization Landscape for Quantized Training","created":"2025-10-09","cited_by_count":6,"area":null},{"id":"2109.00530","title":"A Gradient Sampling Algorithm for Stratified Maps with Applications to Topological Data Analysis","created":"2021-09-01","cited_by_count":5,"area":null},{"id":"2205.05428","title":"An Inexact Augmented Lagrangian Algorithm for Training Leaky ReLU Neural Network with Group Sparsity","created":"2022-05-11","cited_by_count":5,"area":null},{"id":"2207.13266","title":"Sparse Deep Neural Network for Nonlinear Partial Differential Equations","created":"2022-07-27","cited_by_count":5,"area":null},{"id":"2208.02083","title":"Gradient descent provably escapes saddle points in the training of shallow ReLU networks","created":"2022-08-03","cited_by_count":5,"area":null},{"id":"2303.03950","title":"On the existence of optimal shallow feedforward networks with ReLU activation","created":"2023-03-06","cited_by_count":5,"area":null},{"id":"2305.05828","title":"A Normal Map-Based Proximal Stochastic Gradient Method: Convergence and Identification Properties","created":"2023-05-10","cited_by_count":5,"area":null},{"id":"2310.08858","title":"Adam-family Methods with Decoupled Weight Decay in Deep Learning","created":"2023-10-13","cited_by_count":5,"area":null},{"id":"2402.12854","title":"Differentiable Mapper For Topological Optimization Of Data Representation","created":"2024-02-20","cited_by_count":5,"area":null},{"id":"2406.07100","title":"D-GRIL: End-to-End Topological Learning with 2-parameter Persistence","created":"2024-06-11","cited_by_count":5,"area":null},{"id":"2505.09572","title":"SAD Neural Networks: Divergent Gradient Flows and Asymptotic Optimality via o-minimal Structures","created":"2025-05-14","cited_by_count":5,"area":null},{"id":"2101.00699","title":"The structure of conservative gradient fields","created":"2021-01-03","cited_by_count":4,"area":null},{"id":"2101.00935","title":"First-Order Methods for Convex Optimization","created":"2021-01-04","cited_by_count":4,"area":null},{"id":"2307.11714","title":"Convergence of SGD for Training Neural Networks with Sliced Wasserstein Losses","created":"2023-07-21","cited_by_count":4,"area":null},{"id":"2310.04469","title":"Taming Binarized Neural Networks and Mixed-Integer Programs","created":"2023-10-05","cited_by_count":4,"area":null},{"id":"2312.01047","title":"A New Random Reshuffling Method for Nonsmooth Nonconvex Finite-sum Optimization","created":"2023-12-02","cited_by_count":4,"area":null},{"id":"2312.02470","title":"Generator Born from Classifier","created":"2023-12-05","cited_by_count":4,"area":null},{"id":"2406.13936","title":"Communication-Efficient Adaptive Batch Size Strategies for Distributed Local Gradient Methods","created":"2024-06-20","cited_by_count":4,"area":null},{"id":"2103.03570","title":"Second-order step-size tuning of SGD for non-convex optimization","created":"2021-03-05","cited_by_count":3,"area":null},{"id":"2301.13370","title":"On the Correctness of Automatic Differentiation for Neural Networks with Machine-Representable Parameters","created":"2023-01-31","cited_by_count":3,"area":null},{"id":"2307.10053","title":"Stochastic Subgradient Methods with Guaranteed Global Stability in Nonsmooth Nonconvex Optimization","created":"2023-07-19","cited_by_count":3,"area":null},{"id":"2507.15264","title":"On exploration of an interior mirror descent flow for stochastic nonconvex constrained problem","created":"2025-07-21","cited_by_count":3,"area":null},{"id":"2509.18025","title":"Deep Learning as the Disciplined Construction of Tame Objects","created":"2025-09-22","cited_by_count":3,"area":null},{"id":"2602.03461","title":"Soft-Radial Projection for Constrained End-to-End Learning","created":"2026-02-03","cited_by_count":3,"area":null},{"id":"2605.19458","title":"Implicit Bias of Mirror Flow in Homogeneous Neural Networks: Sparse and Dense Feature Learning","created":"2026-05-19","cited_by_count":3,"area":null},{"id":"2101.05201","title":"Optimisation of Spectral Wavelets for Persistence-based Graph Classification","created":"2021-01-10","cited_by_count":2,"area":null},{"id":"2201.10245","title":"On Uniform Boundedness Properties of SGD and its Momentum Variants","created":"2022-01-25","cited_by_count":2,"area":null},{"id":"2206.11533","title":"Stochastic Langevin Differential Inclusions with Applications to Machine Learning","created":"2022-06-23","cited_by_count":2,"area":null},{"id":"2210.03069","title":"PathProx: A Proximal Gradient Algorithm for Weight Decay Regularized Deep Neural Networks","created":"2022-10-06","cited_by_count":2,"area":null},{"id":"2211.03741","title":"AskewSGD : An Annealed interval-constrained Optimisation method to train Quantized Neural Networks","created":"2022-11-07","cited_by_count":2,"area":null},{"id":"2302.12261","title":"Testing Stationarity Concepts for ReLU Networks: Hardness, Regularity, and Robust Algorithms","created":"2023-02-23","cited_by_count":2,"area":null},{"id":"2401.08426","title":"GD doesn't make the cut: Three ways that non-differentiability affects neural network training","created":"2024-01-16","cited_by_count":2,"area":null},{"id":"2404.09438","title":"Developing Lagrangian-based Methods for Nonsmooth Nonconvex Optimization","created":"2024-04-15","cited_by_count":2,"area":null},{"id":"2407.12399","title":"A Practical Solver for Scalar Data Topological Simplification","created":"2024-07-17","cited_by_count":2,"area":null},{"id":"2412.10663","title":"Memory-Efficient 4-bit Preconditioned Stochastic Optimization","created":"2024-12-14","cited_by_count":2,"area":null},{"id":"2109.02455","title":"Stochastic Subgradient Descent on a Generic Definable Function Converges to a Minimizer","created":"2021-09-06","cited_by_count":1,"area":null},{"id":"2201.12052","title":"Improved Overparametrization Bounds for Global Convergence of Stochastic Gradient Descent for Shallow Neural Networks","created":"2022-01-28","cited_by_count":1,"area":null},{"id":"2211.04655","title":"Perturbed Iterate SGD for Lipschitz Continuous Loss Functions with Numerical Error and Adaptive Step Sizes","created":"2022-11-09","cited_by_count":1,"area":null},{"id":"2303.06815","title":"On Model Compression for Neural Networks: Framework, Algorithm, and Convergence Guarantee","created":"2023-03-13","cited_by_count":1,"area":null},{"id":"2306.13275","title":"On The Relationship Between Continual Learning and Long-Tailed Recognition","created":"2023-06-23","cited_by_count":1,"area":null},{"id":"2311.13544","title":"Piecewise Polynomial Regression of Tame Functions via Integer Programming","created":"2023-11-22","cited_by_count":1,"area":null},{"id":"2403.11565","title":"Convergence of Decentralized Stochastic Subgradient-based Methods for Nonsmooth Nonconvex functions","created":"2024-03-18","cited_by_count":1,"area":null},{"id":"2403.14067","title":"Automatic Outlier Rectification via Optimal Transport","created":"2024-03-21","cited_by_count":1,"area":null},{"id":"2404.19517","title":"Inexact subgradient methods for semialgebraic functions","created":"2024-04-30","cited_by_count":1,"area":null},{"id":"2406.19587","title":"Filtration learning in exact multi-parameter persistent homology and classification of time-series data","created":"2024-06-28","cited_by_count":1,"area":null},{"id":"2502.05668","title":"The late-stage training dynamics of (stochastic) subgradient descent on homogeneous neural networks","created":"2025-02-08","cited_by_count":1,"area":null},{"id":"2505.22578","title":"Favorability of Loss Landscape with Weight Decay Requires Both Large Overparametrization and Initialization","created":"2025-05-28","cited_by_count":1,"area":null},{"id":"2509.15368","title":"Stochastic Sample Approximations of (Local) Moduli of Continuity","created":"2025-09-18","cited_by_count":1,"area":null},{"id":"2509.21254","title":"humancompatible.train: Implementing Optimization Algorithms for Stochastically-Constrained Stochastic Optimization Problems","created":"2025-09-25","cited_by_count":1,"area":null},{"id":"2512.18059","title":"Approximation and learning with compositional tensor trains","created":"2025-12-19","cited_by_count":1,"area":null},{"id":"2603.16042","title":"Shuffling the Stochastic Mirror Descent via Dual Lipschitz Continuity and Kernel Conditioning","created":"2026-03-17","cited_by_count":1,"area":null},{"id":"2605.08546","title":"Sliced Inner Product Gromov-Wasserstein Distances","created":"2026-05-08","cited_by_count":1,"area":null},{"id":"2605.29547","title":"Singularity-aware Optimization via Randomized Geometric Probing: Towards Stable Non-smooth Optimization","created":"2026-05-28","cited_by_count":1,"area":null},{"id":"2606.08291","title":"On solving symmetric multi-type orthogonal non-negative matrix tri-factorization problem","created":"2026-06-06","cited_by_count":1,"area":null},{"id":"2206.13646","title":"On bounds for norms of reparameterized ReLU artificial neural network parameters: sums of fractional powers of the Lipschitz norm control the network parameter vector","created":"2022-06-27","cited_by_count":0,"area":null},{"id":"2302.00709","title":"Tame Riemannian Stochastic Approximation","created":"2023-02-01","cited_by_count":0,"area":null},{"id":"2310.20060","title":"AdaSub: Stochastic Optimization Using Second-Order Information in Low-Dimensional Subspaces","created":"2023-10-30","cited_by_count":0,"area":null},{"id":"2401.02736","title":"On the numerical reliability of nonsmooth autodiff: a MaxPool case study","created":"2024-01-05","cited_by_count":0,"area":null},{"id":"2409.10323","title":"On the Hardness of Meaningful Local Guarantees in Nonsmooth Nonconvex Optimization","created":"2024-09-16","cited_by_count":0,"area":null},{"id":"2410.05871","title":"A second-order-like optimizer with adaptive gradient scaling for deep learning","created":"2024-10-08","cited_by_count":0,"area":null},{"id":"2412.06070","title":"Stochastic Gradient Descent Revisited","created":"2024-12-08","cited_by_count":0,"area":null},{"id":"2505.12419","title":"Embedding principle of homogeneous neural network for classification problem","created":"2025-05-18","cited_by_count":0,"area":null},{"id":"2505.18327","title":"Online Statistical Inference of Constrained Stochastic Optimization via Random Scaling","created":"2025-05-23","cited_by_count":0,"area":null},{"id":"2507.04033","title":"Benchmarking Stochastic Approximation Algorithms for Fairness-Constrained Training of Deep Neural Networks","created":"2025-07-05","cited_by_count":0,"area":null},{"id":"2507.19895","title":"Douglas-Rachford Splitting for Group-Sparse Feedback Linear-Quadratic Control","created":"2025-07-26","cited_by_count":0,"area":null},{"id":"2508.17995","title":"Topology Aware Neural Interpolation of Scalar Fields","created":"2025-08-25","cited_by_count":0,"area":null},{"id":"2509.26311","title":"Ultra-Reliable Risk-Aggregated Sum Rate Maximization via Model-Aided Deep Learning","created":"2025-09-30","cited_by_count":0,"area":null}],"next_cursor":"100"}