{"total":163,"rows":[{"id":"2503.20762","title":"ASGO: Adaptive Structured Gradient Optimization","created":"2025-03-26","cited_by_count":57,"area":null},{"id":"2306.03638","title":"Provable convergence guarantees for black-box variational inference","created":"2023-06-04","cited_by_count":29,"area":null},{"id":"2305.07583","title":"MoMo: Momentum Models for Adaptive Learning Rates","created":"2023-05-12","cited_by_count":24,"area":null},{"id":"2401.00604","title":"SteinDreamer: Variance Reduction for Text-to-3D Score Distillation via Stein Identity","created":"2023-12-31","cited_by_count":23,"area":null},{"id":"2402.17457","title":"Super Consistency of Neural Network Landscapes and Learning Rate Transfer","created":"2024-02-27","cited_by_count":23,"area":null},{"id":"2407.16936","title":"Provable Benefit of Annealed Langevin Monte Carlo for Non-log-concave Sampling","created":"2024-07-24","cited_by_count":23,"area":null},{"id":"2305.15349","title":"On the Convergence of Black-Box Variational Inference","created":"2023-05-24","cited_by_count":22,"area":null},{"id":"2306.02601","title":"Aiming towards the minimizers: fast convergence of SGD for overparametrized problems","created":"2023-06-05","cited_by_count":22,"area":null},{"id":"2402.14758","title":"Batch and match: black-box variational inference with a score-based divergence","created":"2024-02-22","cited_by_count":22,"area":null},{"id":"2406.15244","title":"AdaGrad under Anisotropic Smoothness","created":"2024-06-21","cited_by_count":22,"area":null},{"id":"2410.11268","title":"Bypassing the Exponential Dependency: Looped Transformers Efficiently Learn In-context by Multi-step Gradient Descent","created":"2024-10-15","cited_by_count":22,"area":null},{"id":"2306.14969","title":"On the Sample Complexity of Quantum Boltzmann Machine Learning","created":"2023-06-26","cited_by_count":19,"area":null},{"id":"2410.23232","title":"Attribute-to-Delete: Machine Unlearning via Datamodel Matching","created":"2024-10-30","cited_by_count":18,"area":"safety"},{"id":"2504.09951","title":"Towards Weaker Variance Assumptions for Stochastic Optimization","created":"2025-04-14","cited_by_count":17,"area":null},{"id":"2307.11782","title":"Convergence of Adam for Non-convex Objectives: Relaxed Hyperparameters and Non-ergodic Case","created":"2023-07-20","cited_by_count":14,"area":null},{"id":"2406.05033","title":"Gradient Descent on Logistic Regression with Non-Separable Data and Large Step Sizes","created":"2024-06-07","cited_by_count":14,"area":null},{"id":"2410.20634","title":"Plastic Learning with Deep Fourier Features","created":"2024-10-27","cited_by_count":14,"area":null},{"id":"2402.08508","title":"A PAC-Bayesian Link Between Generalisation and Flat Minima","created":"2024-02-13","cited_by_count":13,"area":null},{"id":"2406.04142","title":"Stochastic Polyak Step-sizes and Momentum: Convergence Guarantees and Practical Performance","created":"2024-06-06","cited_by_count":13,"area":null},{"id":"2402.07101","title":"On the Complexity of First-Order Methods in Stochastic Bilevel Optimization","created":"2024-02-11","cited_by_count":12,"area":null},{"id":"2603.10067","title":"HTMuon: Improving Muon via Heavy-Tailed Spectral Correction","created":"2026-03-10","cited_by_count":12,"area":null},{"id":"2305.17581","title":"Knowledge Distillation Performs Partial Variance Reduction","created":"2023-05-27","cited_by_count":11,"area":"distill"},{"id":"2406.04012","title":"Theoretical Guarantees for Variational Inference with Fixed-Variance Mixture of Gaussians","created":"2024-06-06","cited_by_count":11,"area":null},{"id":"2409.08770","title":"Increasing Both Batch Size and Learning Rate Accelerates Stochastic Gradient Descent","created":"2024-09-13","cited_by_count":11,"area":null},{"id":"2411.01803","title":"Gradient Methods with Online Scaling","created":"2024-11-04","cited_by_count":11,"area":null},{"id":"2502.02870","title":"Uncertainty Quantification with the Empirical Neural Tangent Kernel","created":"2025-02-05","cited_by_count":11,"area":null},{"id":"2307.14642","title":"Linear Convergence of Black-Box Variational Inference: Should We Stick the Landing?","created":"2023-07-27","cited_by_count":10,"area":null},{"id":"2407.04358","title":"An Adaptive Stochastic Gradient Method with Non-negative Gauss-Newton Stepsizes","created":"2024-07-05","cited_by_count":10,"area":null},{"id":"2512.18248","title":"On the Convergence Rate of LoRA Gradient Descent","created":"2025-12-20","cited_by_count":10,"area":null},{"id":"2603.15958","title":"Deriving Hyperparameter Scaling Laws via Modern Optimization Theory","created":"2026-03-16","cited_by_count":10,"area":null},{"id":"2409.10068","title":"Spatiotemporal Covariance Neural Networks","created":"2024-09-16","cited_by_count":9,"area":null},{"id":"2411.01713","title":"Rethinking Weight Decay for Robust Fine-Tuning of Foundation Models","created":"2024-11-03","cited_by_count":9,"area":null},{"id":"2411.09998","title":"Adaptive Non-uniform Timestep Sampling for Accelerating Diffusion Model Training","created":"2024-11-15","cited_by_count":9,"area":"diffusion"},{"id":"2502.17323","title":"When to Forget? Complexity Trade-offs in Machine Unlearning","created":"2025-02-24","cited_by_count":9,"area":"safety"},{"id":"2511.08379","title":"SOM Directions are Better than One: Multi-Directional Refusal Suppression in Language Models","created":"2025-11-11","cited_by_count":9,"area":"alignment"},{"id":"2605.08980","title":"Muon Does Not Converge on Convex Lipschitz Functions","created":"2026-05-09","cited_by_count":9,"area":null},{"id":"2305.08552","title":"Curvature-Aware Training for Coordinate Networks","created":"2023-05-15","cited_by_count":8,"area":null},{"id":"2307.14528","title":"Function Value Learning: Adaptive Learning Rates Based on the Polyak Stepsize and Function Splitting in ERM","created":"2023-07-26","cited_by_count":8,"area":null},{"id":"2410.12455","title":"Loss Landscape Characterization of Neural Networks without Over-Parametrization","created":"2024-10-16","cited_by_count":8,"area":null},{"id":"2502.06761","title":"When, Where and Why to Average Weights?","created":"2025-02-10","cited_by_count":8,"area":null},{"id":"2504.19426","title":"Sharp higher order convergence rates for the Adam optimizer","created":"2025-04-28","cited_by_count":8,"area":null},{"id":"2405.19440","title":"MGDA Converges under Generalized Smoothness, Provably","created":"2024-05-29","cited_by_count":7,"area":null},{"id":"2410.01656","title":"Efficient Statistics With Unknown Truncation, Polynomial Time Algorithms, Beyond Gaussians","created":"2024-10-02","cited_by_count":7,"area":null},{"id":"2506.06194","title":"Transformative or Conservative? Conservation laws for ResNets and Transformers","created":"2025-06-06","cited_by_count":7,"area":null},{"id":"2512.03768","title":"Deep Unfolding: Recent Developments, Theory, and Design Guidelines","created":"2025-12-03","cited_by_count":7,"area":null},{"id":"2305.12056","title":"Uniform-in-Time Wasserstein Stability Bounds for (Noisy) Stochastic Gradient Descent","created":"2023-05-20","cited_by_count":6,"area":null},{"id":"2402.05453","title":"Mitigating Privacy Risk in Membership Inference by Convex-Concave Loss","created":"2024-02-08","cited_by_count":6,"area":"safety"},{"id":"2404.00158","title":"Fully Zeroth-Order Bilevel Programming via Gaussian Smoothing","created":"2024-03-29","cited_by_count":6,"area":null},{"id":"2411.04358","title":"Robust and Efficient Fine-tuning of LLMs with Bayesian Reparameterization of Low-Rank Adaptation","created":"2024-11-07","cited_by_count":6,"area":null},{"id":"2601.21698","title":"Curriculum Learning for LLM Pretraining: An Analysis of Learning Dynamics","created":"2026-01-29","cited_by_count":6,"area":null},{"id":"2405.13592","title":"Almost sure convergence rates of stochastic gradient methods under gradient domination","created":"2024-05-22","cited_by_count":5,"area":"deeprl"},{"id":"2405.15979","title":"BadGD: A unified data-centric framework to identify gradient descent vulnerabilities","created":"2024-05-24","cited_by_count":5,"area":"safety"},{"id":"2501.18363","title":"Exploring the Noise Robustness of Online Conformal Prediction","created":"2025-01-30","cited_by_count":5,"area":null},{"id":"2502.02002","title":"The Ball-Proximal (=\"Broximal\") Point Method: a New Algorithm, Convergence Theory, and Applications","created":"2025-02-04","cited_by_count":5,"area":null},{"id":"2502.17009","title":"Unbiased and Sign Compression in Distributed Learning: Comparing Noise Resilience via SDEs","created":"2025-02-24","cited_by_count":5,"area":null},{"id":"2504.01898","title":"Analysis of an Idealized Stochastic Polyak Method and its Application to Black-Box Model Distillation","created":"2025-04-02","cited_by_count":5,"area":null},{"id":"2505.04514","title":"Quantum thermodynamics and semi-definite optimization","created":"2025-05-07","cited_by_count":5,"area":null},{"id":"2505.22922","title":"Scalable Parameter and Memory Efficient Pretraining for LLM: Recent Algorithmic Advances and Benchmarking","created":"2025-05-28","cited_by_count":5,"area":null},{"id":"2505.23737","title":"On the Convergence Analysis of Muon","created":"2025-05-29","cited_by_count":5,"area":null},{"id":"2601.23135","title":"Why GRPO Needs Normalization: A Local-Curvature Perspective on Adaptive Gradients","created":"2026-01-30","cited_by_count":5,"area":"lr"},{"id":"2603.04061","title":"Fermi-Dirac thermal measurements: A framework for quantum hypothesis testing and semidefinite optimization","created":"2026-03-04","cited_by_count":5,"area":null},{"id":"2310.14661","title":"Tractable MCMC for Private Learning with Pure and Gaussian Differential Privacy","created":"2023-10-23","cited_by_count":4,"area":null},{"id":"2312.01432","title":"Fast Dual Subgradient Optimization of the Integrated Transportation Distance Between Stochastic Kernels","created":"2023-12-03","cited_by_count":4,"area":null},{"id":"2401.06566","title":"Maximum Causal Entropy IRL in Mean-Field Games and GNEP Framework for Forward RL","created":"2024-01-12","cited_by_count":4,"area":"offlinerl"},{"id":"2401.10989","title":"Provably Scalable Black-Box Variational Inference with Structured Variational Families","created":"2024-01-19","cited_by_count":4,"area":null},{"id":"2405.14273","title":"Exact Solution to Data-Driven Inverse Optimization of MILPs in Finite Time via Gradient-Based Methods","created":"2024-05-23","cited_by_count":4,"area":null},{"id":"2303.13326","title":"Decentralized Adversarial Training over Graphs","created":"2023-03-23","cited_by_count":3,"area":null},{"id":"2305.06137","title":"A proof of convergence of inverse reinforcement learning for multi-objective optimization","created":"2023-05-10","cited_by_count":3,"area":"offlinerl"},{"id":"2402.07108","title":"Decoupling Learning and Decision-Making: Breaking the $\\mathcal{O}(\\sqrt{T})$ Barrier in Online Resource Allocation with First-Order Methods","created":"2024-02-11","cited_by_count":3,"area":null},{"id":"2403.02051","title":"Privacy of SGD under Gaussian or Heavy-Tailed Noise: Guarantees without Gradient Clipping","created":"2024-03-04","cited_by_count":3,"area":null},{"id":"2405.15010","title":"Parameter-free Clipped Gradient Descent Meets Polyak","created":"2024-05-23","cited_by_count":3,"area":null},{"id":"2501.18528","title":"Joint Learning of Energy-based Models and their Partition Function","created":"2025-01-30","cited_by_count":3,"area":null},{"id":"2504.04274","title":"Randomised Splitting Methods and Stochastic Gradient Descent","created":"2025-04-05","cited_by_count":3,"area":null},{"id":"2505.11434","title":"Controlling the Flow: Stability and Convergence for Stochastic Gradient Descent with Decaying Regularization","created":"2025-05-16","cited_by_count":3,"area":null},{"id":"2505.12378","title":"Efficient Optimization with Orthogonality Constraint: a Randomized Riemannian Submanifold Method","created":"2025-05-18","cited_by_count":3,"area":null},{"id":"2508.00775","title":"Learning to optimize with guarantees: a complete characterization of linearly convergent algorithms","created":"2025-08-01","cited_by_count":3,"area":null},{"id":"2509.02970","title":"Delayed Momentum Aggregation: Communication-efficient Byzantine-robust Federated Learning with Partial Participation","created":"2025-09-03","cited_by_count":3,"area":null},{"id":"2303.11602","title":"Convergence of variational Monte Carlo simulation and scale-invariant pre-training","created":"2023-03-21","cited_by_count":2,"area":null},{"id":"2312.03311","title":"On the Nystrom Approximation for Preconditioning in Kernel Machines","created":"2023-12-06","cited_by_count":2,"area":null},{"id":"2403.00853","title":"Parallel Momentum Methods Under Biased Gradient Estimations","created":"2024-02-29","cited_by_count":2,"area":null},{"id":"2405.18222","title":"From Learning to Optimize to Learning Optimization Algorithms","created":"2024-05-28","cited_by_count":2,"area":null},{"id":"2406.00920","title":"Demystifying SGD with Doubly Stochastic Gradients","created":"2024-06-03","cited_by_count":2,"area":"diffusion"},{"id":"2407.14111","title":"A Mirror Descent-Based Algorithm for Corruption-Tolerant Distributed Gradient Descent","created":"2024-07-19","cited_by_count":2,"area":null},{"id":"2501.16055","title":"Random Reshuffling for Stochastic Gradient Langevin Dynamics","created":"2025-01-27","cited_by_count":2,"area":null},{"id":"2503.21071","title":"Purifying Approximate Differential Privacy with Randomized Post-processing","created":"2025-03-27","cited_by_count":2,"area":null},{"id":"2504.15399","title":"Improving Learning to Optimize Using Parameter Symmetries","created":"2025-04-21","cited_by_count":2,"area":null},{"id":"2505.17965","title":"Bias-Optimal Bounds for SGD: A Computer-Aided Lyapunov Analysis","created":"2025-05-23","cited_by_count":2,"area":null},{"id":"2505.21651","title":"AutoSGD: Automatic Learning Rate Selection for Stochastic Gradient Descent","created":"2025-05-27","cited_by_count":2,"area":null},{"id":"2508.09103","title":"Constrained free energy minimization for the design of thermal states and stabilizer thermodynamic systems","created":"2025-08-12","cited_by_count":2,"area":null},{"id":"2508.21022","title":"A Sketch-and-Project Analysis of Subsampled Natural Gradient Algorithms","created":"2025-08-28","cited_by_count":2,"area":null},{"id":"2510.04686","title":"How does the optimizer implicitly bias the model merging loss landscape?","created":"2025-10-06","cited_by_count":2,"area":null},{"id":"2510.12013","title":"Statistical Guarantees for High-Dimensional Stochastic Gradient Descent","created":"2025-10-13","cited_by_count":2,"area":null},{"id":"2511.19716","title":"Design Criteria for SGD Preconditioners: Local Conditioning, Noise Floors, and Basin Stability","created":"2025-11-24","cited_by_count":2,"area":null},{"id":"2601.02386","title":"Tree of Preferences for Diversified Recommendation","created":"2025-12-24","cited_by_count":2,"area":null},{"id":"2602.04872","title":"Multi-layer Cross-attention is Provably Optimal for Multi-modal In-context Learning","created":"2026-02-04","cited_by_count":2,"area":null},{"id":"2602.10691","title":"Convergence Rates for Distribution Matching with Sliced Optimal Transport","created":"2026-02-11","cited_by_count":2,"area":null},{"id":"2603.15059","title":"Muon Converges under Heavy-Tailed Noise: Nonconvex H\\\"{o}lder-Smooth Empirical Risk Minimization","created":"2026-03-16","cited_by_count":2,"area":null},{"id":"2606.02365","title":"FOAM: Frequency and Operator Error-Based Adaptive Damping Method for Reducing Staleness-Oriented Error for Shampoo","created":"2026-06-01","cited_by_count":2,"area":null},{"id":"2606.32005","title":"Random Reshuffling Dominates Stochastic Gradient Descent","created":"2026-06-30","cited_by_count":2,"area":null},{"id":"2303.16952","title":"Meta-Learning Parameterized First-Order Optimizers using Differentiable Convex Optimization","created":"2023-03-29","cited_by_count":1,"area":null}],"next_cursor":"100"}