{"total":72,"rows":[{"id":"2106.04350","title":"Nonsmooth Implicit Differentiation for Machine Learning and Optimization","created":"2021-06-08","cited_by_count":43,"area":null},{"id":"2209.05045","title":"Gradient-Free Methods for Deterministic and Stochastic Nonsmooth Nonconvex Optimization","created":"2022-09-12","cited_by_count":43,"area":null},{"id":"2501.18965","title":"The Surprising Agreement Between Convex Optimization Theory and Learning-Rate Scheduling for Large Model Training","created":"2025-01-31","cited_by_count":33,"area":null},{"id":"2302.08300","title":"Deterministic Nonsmooth Nonconvex Optimization","created":"2023-02-16","cited_by_count":26,"area":null},{"id":"2206.00457","title":"Automatic differentiation of nonsmooth iterative algorithms","created":"2022-05-31","cited_by_count":25,"area":null},{"id":"2105.01637","title":"Implicit differentiation for fast hyperparameter selection in non-smooth convex learning","created":"2021-05-04","cited_by_count":22,"area":null},{"id":"2305.03938","title":"Adam-family Methods for Nonsmooth Optimization with Convergence Guarantees","created":"2023-05-06","cited_by_count":22,"area":null},{"id":"2510.01755","title":"Learning Regularization Functionals for Inverse Problems: A Comparative Study","created":"2025-10-02","cited_by_count":15,"area":null},{"id":"2307.10352","title":"Properties of Discrete Sliced Wasserstein Losses","created":"2023-07-19","cited_by_count":12,"area":null},{"id":"2107.04479","title":"Convergence analysis for gradient flows in the training of artificial neural networks with ReLU activation","created":"2021-07-09","cited_by_count":11,"area":null},{"id":"2108.02072","title":"Stochastic Subgradient Descent Escapes Active Strict Saddles on Weakly Convex Functions","created":"2021-08-04","cited_by_count":9,"area":null},{"id":"2111.10489","title":"Modeling Design and Control Problems Involving Neural Network Surrogates","created":"2021-11-20","cited_by_count":9,"area":null},{"id":"2403.08121","title":"Early Directional Convergence in Deep Homogeneous Neural Networks for Small Initializations","created":"2024-03-12","cited_by_count":7,"area":null},{"id":"2505.22049","title":"Differentiable Generalized Sliced Wasserstein Plans","created":"2025-05-28","cited_by_count":7,"area":null},{"id":"2503.01660","title":"Non-convergence to the optimal risk for Adam and stochastic gradient descent optimization in the training of deep neural networks","created":"2025-03-03","cited_by_count":6,"area":null},{"id":"2205.05428","title":"An Inexact Augmented Lagrangian Algorithm for Training Leaky ReLU Neural Network with Group Sparsity","created":"2022-05-11","cited_by_count":5,"area":null},{"id":"2212.07844","title":"Differentiating Nonsmooth Solutions to Parametric Monotone Inclusion Problems","created":"2022-12-15","cited_by_count":5,"area":null},{"id":"2310.08858","title":"Adam-family Methods with Decoupled Weight Decay in Deep Learning","created":"2023-10-13","cited_by_count":5,"area":null},{"id":"2406.12289","title":"Stability of Data-Dependent Ridge-Regularization for Inverse Problems","created":"2024-06-18","cited_by_count":5,"area":null},{"id":"2101.00699","title":"The structure of conservative gradient fields","created":"2021-01-03","cited_by_count":4,"area":null},{"id":"2206.01730","title":"On the complexity of nonsmooth automatic differentiation","created":"2022-06-01","cited_by_count":4,"area":null},{"id":"2208.03107","title":"Fixed-Point Automatic Differentiation of Forward--Backward Splitting Algorithms for Partly Smooth Functions","created":"2022-08-05","cited_by_count":4,"area":null},{"id":"2307.11714","title":"Convergence of SGD for Training Neural Networks with Sliced Wasserstein Losses","created":"2023-07-21","cited_by_count":4,"area":null},{"id":"2310.04469","title":"Taming Binarized Neural Networks and Mixed-Integer Programs","created":"2023-10-05","cited_by_count":4,"area":null},{"id":"2601.23096","title":"CATTO: Balancing Preferences and Confidence in Language Models","created":"2026-01-30","cited_by_count":4,"area":"alignment"},{"id":"2301.13370","title":"On the Correctness of Automatic Differentiation for Neural Networks with Machine-Representable Parameters","created":"2023-01-31","cited_by_count":3,"area":null},{"id":"2307.10053","title":"Stochastic Subgradient Methods with Guaranteed Global Stability in Nonsmooth Nonconvex Optimization","created":"2023-07-19","cited_by_count":3,"area":null},{"id":"2507.15264","title":"On exploration of an interior mirror descent flow for stochastic nonconvex constrained problem","created":"2025-07-21","cited_by_count":3,"area":null},{"id":"2509.18025","title":"Deep Learning as the Disciplined Construction of Tame Objects","created":"2025-09-22","cited_by_count":3,"area":null},{"id":"2608.20442","title":"Stored in Optimizer State, Valued by Later Training: A Causal Account of Subliminal Trait Transfer","created":"2026-08-20","cited_by_count":3,"area":null},{"id":"2206.11533","title":"Stochastic Langevin Differential Inclusions with Applications to Machine Learning","created":"2022-06-23","cited_by_count":2,"area":null},{"id":"2401.08426","title":"GD doesn't make the cut: Three ways that non-differentiability affects neural network training","created":"2024-01-16","cited_by_count":2,"area":null},{"id":"2403.11687","title":"Nonsmooth Implicit Differentiation: Deterministic and Stochastic Convergence Rates","created":"2024-03-18","cited_by_count":2,"area":null},{"id":"2404.00390","title":"Learning truly monotone operators with applications to nonlinear inverse problems","created":"2024-03-30","cited_by_count":2,"area":null},{"id":"2404.09438","title":"Developing Lagrangian-based Methods for Nonsmooth Nonconvex Optimization","created":"2024-04-15","cited_by_count":2,"area":null},{"id":"2412.10663","title":"Memory-Efficient 4-bit Preconditioned Stochastic Optimization","created":"2024-12-14","cited_by_count":2,"area":null},{"id":"2505.11370","title":"Understanding Nonlinear Implicit Bias via Region Counts in Input Space","created":"2025-05-16","cited_by_count":2,"area":null},{"id":"2109.02455","title":"Stochastic Subgradient Descent on a Generic Definable Function Converges to a Minimizer","created":"2021-09-06","cited_by_count":1,"area":null},{"id":"2201.03819","title":"Path differentiability of ODE flows","created":"2022-01-11","cited_by_count":1,"area":null},{"id":"2304.12004","title":"Designing Optimal Personalized Incentive for Traffic Routing using BIG Hype algorithm","created":"2023-04-24","cited_by_count":1,"area":null},{"id":"2311.13544","title":"Piecewise Polynomial Regression of Tame Functions via Integer Programming","created":"2023-11-22","cited_by_count":1,"area":null},{"id":"2404.19517","title":"Inexact subgradient methods for semialgebraic functions","created":"2024-04-30","cited_by_count":1,"area":null},{"id":"2410.15923","title":"Automatic Differentiation of Optimization Algorithms with Time-Varying Updates","created":"2024-10-21","cited_by_count":1,"area":null},{"id":"2502.05668","title":"The late-stage training dynamics of (stochastic) subgradient descent on homogeneous neural networks","created":"2025-02-08","cited_by_count":1,"area":null},{"id":"2505.22509","title":"Accelerating Optimization via Differentiable Stopping Time","created":"2025-05-28","cited_by_count":1,"area":null},{"id":"2509.15368","title":"Stochastic Sample Approximations of (Local) Moduli of Continuity","created":"2025-09-18","cited_by_count":1,"area":null},{"id":"2603.04133","title":"Exploiting Subgradient Sparsity in Max-Plus Neural Networks","created":"2026-03-04","cited_by_count":1,"area":null},{"id":"2603.17628","title":"rSDNet: Unified Robust Neural Learning against Label Noise and Adversarial Attacks","created":"2026-03-18","cited_by_count":1,"area":null},{"id":"2605.24477","title":"The Normalized Maximum Likelihood for Regular Non-Smooth Models: Measure-Theoretic Foundations and Geometric Sampling","created":"2026-05-23","cited_by_count":1,"area":null},{"id":"2106.12915","title":"Numerical influence of ReLU'(0) on backpropagation","created":"2021-06-23","cited_by_count":0,"area":null},{"id":"2302.00709","title":"Tame Riemannian Stochastic Approximation","created":"2023-02-01","cited_by_count":0,"area":null},{"id":"2401.02736","title":"On the numerical reliability of nonsmooth autodiff: a MaxPool case study","created":"2024-01-05","cited_by_count":0,"area":null},{"id":"2403.18248","title":"Statistical Inference of Optimal Allocations I: Regularities and their Implications","created":"2024-03-27","cited_by_count":0,"area":null},{"id":"2410.05871","title":"A second-order-like optimizer with adaptive gradient scaling for deep learning","created":"2024-10-08","cited_by_count":0,"area":null},{"id":"2412.16893","title":"Preventing Non-intrusive Load Monitoring Privacy Invasion: A Precise Adversarial Attack Scheme for Networked Smart Meters","created":"2024-12-22","cited_by_count":0,"area":null},{"id":"2502.00047","title":"HadamRNN: Binary and Sparse Ternary Orthogonal RNNs","created":"2025-01-28","cited_by_count":0,"area":null},{"id":"2505.11752","title":"Permutation Randomization on Nonsmooth Nonconvex Optimization: A Theoretical and Experimental Study","created":"2025-05-16","cited_by_count":0,"area":null},{"id":"2505.12419","title":"Embedding principle of homogeneous neural network for classification problem","created":"2025-05-18","cited_by_count":0,"area":null},{"id":"2510.10214","title":"Distributionally Robust Control with End-to-End Statistically Guaranteed Metric Learning","created":"2025-10-11","cited_by_count":0,"area":null},{"id":"2602.09842","title":"Step-Size Stability in Stochastic Optimization: A Theoretical Perspective","created":"2026-02-10","cited_by_count":0,"area":null},{"id":"2604.11639","title":"Inter-Layer Hessian Analysis of Neural Networks with DAG Architectures","created":"2026-04-13","cited_by_count":0,"area":null},{"id":"2605.11526","title":"Efficient and provably convergent end-to-end training of deep neural networks with linear constraints","created":"2026-05-12","cited_by_count":0,"area":null},{"id":"2605.23937","title":"BoxLitE: A Faithful Knowledge Base Embedding Based on Convex Optimization","created":"2026-04-27","cited_by_count":0,"area":null},{"id":"2605.26640","title":"Sample Complexity of Policy Gradient for Log-Growth Control","created":"2026-05-26","cited_by_count":0,"area":"deeprl"},{"id":"2605.28134","title":"Convergence of empirical subgradients for optimal transport-based objectives","created":"2026-05-27","cited_by_count":0,"area":null},{"id":"2606.16564","title":"Elastic ODYN: Differentiable Optimization for Infeasible Control and Learning in Robotics","created":"2026-06-15","cited_by_count":0,"area":null},{"id":"2607.01755","title":"Decentralized Stochastic Subgradient-type Methods with Communication Compression for Nonsmooth Nonconvex Optimization","created":"2026-07-02","cited_by_count":0,"area":null},{"id":"2607.20411","title":"Lipschitzian SLLNs for random functions","created":"2026-07-22","cited_by_count":0,"area":null},{"id":"2609.13677","title":"Nonsmooth Optimization via Orthogonalized Momentum","created":"2026-09-12","cited_by_count":0,"area":null},{"id":"2609.34667","title":"Two-Timescale Fine-tuning Provably Learns New Features for Two-Layer ReLU Networks","created":"2026-09-28","cited_by_count":0,"area":null},{"id":"2609.38786","title":"Same Loss, Different Gradients","created":"2026-09-30","cited_by_count":0,"area":null},{"id":"2610.05789","title":"Dimension-Free Decentralized Nonsmooth Nonconvex Stochastic Optimization","created":"2026-10-05","cited_by_count":0,"area":null}],"next_cursor":null}