{"total":107,"rows":[{"id":"2105.02716","title":"Noether's Learning Dynamics: Role of Symmetry Breaking in Neural Networks","created":"2021-05-06","cited_by_count":50,"area":null},{"id":"2107.06608","title":"Continuous vs. Discrete Optimization of Deep Neural Networks","created":"2021-07-14","cited_by_count":34,"area":null},{"id":"2105.08158","title":"The Confluence of Networks, Games and Learning","created":"2021-05-17","cited_by_count":26,"area":null},{"id":"2306.05445","title":"Towards Predicting Equilibrium Distributions for Molecular Systems with Deep Learning","created":"2023-06-08","cited_by_count":26,"area":null},{"id":"2111.11309","title":"No-Regret Dynamics in the Fenchel Game: A Unified Framework for Algorithmic Convex Optimization","created":"2021-11-22","cited_by_count":20,"area":null},{"id":"2106.07644","title":"A Continuized View on Nesterov Acceleration for Stochastic Gradient Descent and Randomized Gossip","created":"2021-06-10","cited_by_count":15,"area":null},{"id":"2105.13922","title":"Discretization Drift in Two-Player Games","created":"2021-05-28","cited_by_count":14,"area":null},{"id":"2107.08225","title":"On Constraints in First-Order Optimization: A View from Non-Smooth Dynamical Systems","created":"2021-07-17","cited_by_count":13,"area":null},{"id":"2206.04160","title":"Alternating Mirror Descent for Constrained Min-Max Games","created":"2022-06-08","cited_by_count":13,"area":null},{"id":"2205.14173","title":"Momentum Stiefel Optimizer, with Applications to Suitably-Orthogonal Attention, and Optimal Transport","created":"2022-05-27","cited_by_count":11,"area":null},{"id":"2405.12888","title":"Keep the Momentum: Conservation Laws beyond Euclidean Gradient Flows","created":"2024-05-21","cited_by_count":11,"area":null},{"id":"2110.07034","title":"How Does Momentum Benefit Deep Neural Networks Architecture Design? A Few Case Studies","created":"2021-10-13","cited_by_count":10,"area":null},{"id":"2310.04006","title":"Accelerating optimization over the space of probability measures","created":"2023-10-06","cited_by_count":10,"area":null},{"id":"2604.14108","title":"Momentum Further Constrains Sharpness at the Edge of Stochastic Stability","created":"2026-04-15","cited_by_count":10,"area":null},{"id":"2209.14501","title":"On Quantum Speedups for Nonconvex Optimization via Quantum Tunneling Walks","created":"2022-09-29","cited_by_count":9,"area":null},{"id":"2210.10019","title":"Towards Understanding GD with Hard and Conjugate Pseudo-labels for Test-Time Adaptation","created":"2022-10-18","cited_by_count":9,"area":null},{"id":"2312.16429","title":"GAD-PVI: A General Accelerated Dynamic-Weight Particle-Based Variational Inference Framework","created":"2023-12-27","cited_by_count":9,"area":null},{"id":"2403.05293","title":"Leveraging Continuous Time to Understand Momentum When Training Diagonal Linear Networks","created":"2024-03-08","cited_by_count":9,"area":null},{"id":"2505.12387","title":"Neural Thermodynamics: Entropic Forces in Deep and Universal Representation Learning","created":"2025-05-18","cited_by_count":9,"area":null},{"id":"2112.13826","title":"Last-Iterate Convergence of Saddle-Point Optimizers via High-Resolution Differential Equations","created":"2021-12-27","cited_by_count":8,"area":null},{"id":"2209.08862","title":"Gradient Norm Minimization of Nesterov Acceleration: $o(1/k^3)$","created":"2022-09-19","cited_by_count":8,"area":null},{"id":"2211.12386","title":"A Recursively Recurrent Neural Network (R2N2) Architecture for Learning Iterative Algorithms","created":"2022-11-22","cited_by_count":8,"area":null},{"id":"2111.06171","title":"Convergence and Stability of the Stochastic Proximal Point Algorithm with Momentum","created":"2021-11-11","cited_by_count":7,"area":null},{"id":"2303.01471","title":"Quantum Hamiltonian Descent","created":"2023-03-02","cited_by_count":7,"area":null},{"id":"2311.15587","title":"Quantum Langevin Dynamics for Optimization","created":"2023-11-27","cited_by_count":7,"area":null},{"id":"2411.09734","title":"Modeling AdaGrad, RMSProp, and Adam with Integro-Differential Equations","created":"2024-11-14","cited_by_count":7,"area":null},{"id":"2501.17049","title":"Hellinger-Kantorovich Gradient Flows: Global Exponential Decay of Entropy Functionals","created":"2025-01-28","cited_by_count":7,"area":null},{"id":"2102.11537","title":"Revisiting the Role of Euler Numerical Integration on Acceleration and Stability in Convex Optimization","created":"2021-02-23","cited_by_count":6,"area":null},{"id":"2107.11231","title":"Optimization on manifolds: A symplectic approach","created":"2021-07-23","cited_by_count":6,"area":null},{"id":"2205.12442","title":"Lyapunov function approach for approximation algorithm design and analysis: with applications in submodular maximization","created":"2022-05-25","cited_by_count":6,"area":null},{"id":"2302.07851","title":"Continuized Acceleration for Quasar Convex Functions in Non-Convex Optimization","created":"2023-02-15","cited_by_count":6,"area":null},{"id":"2203.10592","title":"Geometric Methods for Sampling, Optimisation, Inference and Adaptive Agents","created":"2022-03-20","cited_by_count":5,"area":null},{"id":"2205.03202","title":"Perseus: A Simple and Optimal High-Order Method for Variational Inequalities","created":"2022-05-06","cited_by_count":5,"area":null},{"id":"2208.06619","title":"Riemannian accelerated gradient methods via extrapolation","created":"2022-08-13","cited_by_count":5,"area":null},{"id":"2302.00316","title":"Accelerated First-Order Optimization under Nonlinear Constraints","created":"2023-02-01","cited_by_count":5,"area":null},{"id":"2303.17192","title":"Sublinear Convergence Rates of Extragradient-Type Methods: A Survey on Classical and Recent Developments","created":"2023-03-30","cited_by_count":5,"area":null},{"id":"2601.22257","title":"Symmetry Breaking in Transformers for Efficient and Interpretable Training","created":"2026-01-29","cited_by_count":5,"area":null},{"id":"2101.00935","title":"First-Order Methods for Convex Optimization","created":"2021-01-04","cited_by_count":4,"area":null},{"id":"2101.12101","title":"Potential Function-based Framework for Making the Gradients Small in Convex and Min-Max Optimization","created":"2021-01-28","cited_by_count":4,"area":null},{"id":"2211.14645","title":"Accelerated Riemannian Optimization: Handling Constraints with a Prox to Bound Geometric Penalties","created":"2022-11-26","cited_by_count":4,"area":null},{"id":"2502.09130","title":"Finite-Time Analysis of Discrete-Time Stochastic Interpolants","created":"2025-02-13","cited_by_count":4,"area":null},{"id":"2510.26997","title":"Gradient Descent as Loss Landscape Navigation: a Normative Framework for Deriving Learning Rules","created":"2025-10-30","cited_by_count":4,"area":null},{"id":"2602.16167","title":"Muon with Spectral Guidance: Efficient Optimization for Scientific Machine Learning","created":"2026-02-18","cited_by_count":4,"area":null},{"id":"2105.06577","title":"Online Algorithms and Policies Using Adaptive and Machine Learning Approaches","created":"2021-05-13","cited_by_count":3,"area":null},{"id":"2105.08832","title":"A Contraction Theory Approach to Optimization Algorithms from Acceleration Flows","created":"2021-05-18","cited_by_count":3,"area":null},{"id":"2111.10722","title":"A Deterministic Sampling Method via Maximum Mean Discrepancy Flow with Adaptive Kernel","created":"2021-11-21","cited_by_count":3,"area":null},{"id":"2112.01363","title":"Breaking the Convergence Barrier: Optimization via Fixed-Time Convergent Flows","created":"2021-12-02","cited_by_count":3,"area":null},{"id":"2210.06819","title":"Mean-field analysis for heavy ball methods: Dropout-stability, connectivity, and global convergence","created":"2022-10-13","cited_by_count":3,"area":null},{"id":"2405.10618","title":"Distributed Event-Based Learning via ADMM","created":"2024-05-17","cited_by_count":3,"area":null},{"id":"2410.10118","title":"Physical Consistency Bridges Heterogeneous Data in Molecular Multi-Task Learning","created":"2024-10-14","cited_by_count":3,"area":null},{"id":"2505.19537","title":"Continuous-Time Analysis of Heavy Ball Momentum in Min-Max Games","created":"2025-05-26","cited_by_count":3,"area":null},{"id":"2507.03404","title":"On the Effectiveness of the z-Transform Method in Quadratic Optimization","created":"2025-07-04","cited_by_count":3,"area":null},{"id":"2305.08658","title":"On the connections between optimization algorithms, Lyapunov functions, and differential equations: theory and insights","created":"2023-05-15","cited_by_count":2,"area":null},{"id":"2311.02002","title":"A Variational Perspective on High-Resolution ODEs","created":"2023-11-03","cited_by_count":2,"area":null},{"id":"2407.20620","title":"Accelerated forward-backward and Douglas-Rachford splitting dynamics","created":"2024-07-30","cited_by_count":2,"area":null},{"id":"2509.04008","title":"Towards understanding Accelerated Stein Variational Gradient Flow -- Analysis of Generalized Bilinear Kernels for Gaussian target distributions","created":"2025-09-04","cited_by_count":2,"area":null},{"id":"2106.02700","title":"A Discrete Variational Derivation of Accelerated Methods in Optimization","created":"2021-06-04","cited_by_count":1,"area":null},{"id":"2106.07620","title":"Fast symplectic integrator for Nesterov-type acceleration method","created":"2021-06-01","cited_by_count":1,"area":null},{"id":"2108.12883","title":"A closed loop gradient descent algorithm applied to Rosenbrock's function","created":"2021-08-29","cited_by_count":1,"area":null},{"id":"2203.11992","title":"Resonance in Weight Space: Covariate Shift Can Drive Divergence of SGD with Momentum","created":"2022-03-22","cited_by_count":1,"area":null},{"id":"2206.02001","title":"A PDE-based Explanation of Extreme Numerical Sensitivities and Edge of Stability in Training Neural Networks","created":"2022-06-04","cited_by_count":1,"area":null},{"id":"2206.02034","title":"A Control Theoretic Framework for Adaptive Gradient Optimizers in Machine Learning","created":"2022-06-04","cited_by_count":1,"area":null},{"id":"2304.08389","title":"Beyond first-order methods for non-convex non-concave min-max optimization","created":"2023-04-17","cited_by_count":1,"area":null},{"id":"2304.14642","title":"On Underdamped Nesterov's Acceleration","created":"2023-04-28","cited_by_count":1,"area":null},{"id":"2306.09694","title":"Linear convergence of forward-backward accelerated algorithms without knowledge of the modulus of strong convexity","created":"2023-06-16","cited_by_count":1,"area":null},{"id":"2311.10053","title":"Near-optimal Closed-loop Method via Lyapunov Damping for Convex Optimization","created":"2023-11-16","cited_by_count":1,"area":null},{"id":"2405.20390","title":"Quantitative Convergences of Lie Group Momentum Optimizers","created":"2024-05-30","cited_by_count":1,"area":null},{"id":"2406.13971","title":"Complex fractal trainability boundary can arise from trivial non-convexity","created":"2024-06-20","cited_by_count":1,"area":null},{"id":"2411.19242","title":"Controlling Participation in Federated Learning with Feedback","created":"2024-11-28","cited_by_count":1,"area":null},{"id":"2602.09101","title":"From Adam to Adam-Like Lagrangians: Second-Order Nonlocal Dynamics","created":"2026-02-09","cited_by_count":1,"area":null},{"id":"2603.16535","title":"SympFormer: Accelerated attention blocks via Inertial Dynamics on Density Manifolds","created":"2026-03-17","cited_by_count":1,"area":null},{"id":"2604.06652","title":"FlowAdam: Implicit Regularization via Geometry-Aware Soft Momentum Injection","created":"2026-04-08","cited_by_count":1,"area":null},{"id":"2608.07924","title":"Second Order Drifting Models","created":"2026-08-08","cited_by_count":1,"area":null},{"id":"2103.12868","title":"A High-order Tuner for Accelerated Learning and Control","created":"2021-03-23","cited_by_count":0,"area":null},{"id":"2112.04922","title":"A More Stable Accelerated Gradient Method Inspired by Continuous-Time Perspective","created":"2021-12-09","cited_by_count":0,"area":null},{"id":"2201.08311","title":"Accelerated Gradient Flow: Risk, Stability, and Implicit Regularization","created":"2022-01-20","cited_by_count":0,"area":null},{"id":"2203.02140","title":"Whiplash Gradient Descent Dynamics","created":"2022-03-04","cited_by_count":0,"area":null},{"id":"2204.12707","title":"Accelerated Continuous-Time Approximate Dynamic Programming via Data-Assisted Hybrid Control","created":"2022-04-27","cited_by_count":0,"area":null},{"id":"2207.04934","title":"Multilevel Geometric Optimization for Regularised Constrained Linear Inverse Problems","created":"2022-07-11","cited_by_count":0,"area":null},{"id":"2207.12845","title":"Fixed-Time Convergence for a Class of Nonconvex-Nonconcave Min-Max Problems","created":"2022-07-26","cited_by_count":0,"area":null},{"id":"2212.03765","title":"Generalized Gradient Flows with Provable Fixed-Time Convergence and Fast Evasion of Non-Degenerate Saddle Points","created":"2022-12-07","cited_by_count":0,"area":null},{"id":"2304.04665","title":"On algorithmically boosting fixed-point computations","created":"2023-04-04","cited_by_count":0,"area":null},{"id":"2304.10063","title":"Understanding Accelerated Gradient Methods: Lyapunov Analyses and Hamiltonian Assisted Interpretations","created":"2023-04-20","cited_by_count":0,"area":null},{"id":"2307.03590","title":"Accelerated Optimization Landscape of Linear-Quadratic Regulator","created":"2023-07-07","cited_by_count":0,"area":null},{"id":"2309.04877","title":"A Gentle Introduction to Gradient-Based Optimization and Variational Inequalities for Machine Learning","created":"2023-09-09","cited_by_count":0,"area":null},{"id":"2404.09363","title":"Momentum-based gradient descent methods for Lie groups","created":"2024-04-14","cited_by_count":0,"area":null},{"id":"2404.14358","title":"A General Continuous-Time Formulation of Stochastic ADMM and Its Variants","created":"2024-04-22","cited_by_count":0,"area":null},{"id":"2405.13765","title":"On the stability of gradient descent with second order dynamics for time-varying cost functions","created":"2024-05-22","cited_by_count":0,"area":null},{"id":"2409.00913","title":"Generalized Continuous-Time Models for Nesterov's Accelerated Gradient Methods","created":"2024-09-02","cited_by_count":0,"area":null},{"id":"2409.11713","title":"From exponential to finite/fixed-time stability: Applications to optimization","created":"2024-09-18","cited_by_count":0,"area":null},{"id":"2412.13527","title":"Lyapunov Analysis For Monotonically Forward-Backward Accelerated Algorithms","created":"2024-12-18","cited_by_count":0,"area":null},{"id":"2505.10272","title":"Spike-timing-dependent Hebbian learning as noisy gradient descent","created":"2025-05-15","cited_by_count":0,"area":null},{"id":"2505.14670","title":"Quantum Optimization via Gradient-Based Hamiltonian Descent","created":"2025-05-20","cited_by_count":0,"area":null},{"id":"2505.23369","title":"Dynamic Spectral Backpropagation for Efficient Neural Network Training","created":"2025-05-29","cited_by_count":0,"area":null},{"id":"2512.17598","title":"A Systems-Theoretic View on the Convergence of Algorithms under Disturbances","created":"2025-12-19","cited_by_count":0,"area":null},{"id":"2601.01589","title":"Learning Relationship between Quantum Walks and Underdamped Langevin Dynamics","created":"2026-01-04","cited_by_count":0,"area":null},{"id":"2601.22284","title":"Riemannian Lyapunov Optimizer: A Unified Framework for Optimization","created":"2026-01-29","cited_by_count":0,"area":null},{"id":"2603.03610","title":"Riemannian Optimization in Modular Systems","created":"2026-03-04","cited_by_count":0,"area":null},{"id":"2603.09310","title":"A Gaussian Comparison Theorem for Training Dynamics in Machine Learning","created":"2026-03-10","cited_by_count":0,"area":null},{"id":"2604.17645","title":"On The Mathematics of the Natural Physics of Optimization","created":"2026-04-19","cited_by_count":0,"area":null}],"next_cursor":"100"}