mlsanityData to 7 Oct 2026

Convex optimization

arXiv 2106.01946 ↗First posted 3 Jun 2021math.OC cs.NA math.NAcited by 2,479

Not on the map. Why?

Cited by 57 in Diffusion models, but placed by its own abstract, which didn’t fit.

Abstract (arXiv)

This textbook is based on lectures given by the authors at MIPT (Moscow), HSE (Moscow), FEFU (Vladivostok), V.I. Vernadsky KFU (Simferopol), ASU (Republic of Adygea), and the University of Grenoble-Alpes (Grenoble, France). First of all, the authors focused on the program of a two-semester course of lectures on convex optimization, which is given to students of MIPT. The first chapter of this book contains the materials of the first semester ("Fundamentals of convex analysis and optimization"), the second and third chapters contain the materials of the second semester ("Numerical methods of convex optimization"). The textbook has a number of features. First, in contrast to the classic manuals, this book does not provide proofs of all the theorems mentioned. This allowed, on one side, to describe more themes, but on the other side, made the presentation less self-sufficient. The second important point is that part of the material is advanced and is published in the Russian educational literature, apparently for the first time. Third, the accents that are given do not always coincide with the generally accepted accents in the textbooks that are now popular. First of all, we talk about a sufficiently advanced presentation of conic optimization, including robust optimization, as a vivid demonstration of the capabilities of modern convex analysis.

Key facts. Cited by 2,479 papers in the map (data through 7 Oct 2026). First posted on arXiv 3 Jun 2021.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 206; 2022: 394; 2023: 489; 2024: 488; 2025: 475; 2026: 427.

2,479 papers.

Sort:

By area:

  1. 2022Multi-Concept Customization of Text-to-Image Diffusioncited by 1,099
  2. 2023A General Theoretical Paradigm to Understand Learning from Human Preferencescited by 906
  3. 2021Solving Inverse Problems in Medical Imaging with Score-Based Generative Modelscited by 514
  4. 2023Iterative Preference Learning from Human Feedback: Bridging Theory and Practice for RLHF under KL-Constraintcited by 346
  5. 2024MoGe: Unlocking Accurate Monocular Geometry Estimation for Open-Domain Images with Optimal Training Supervisioncited by 290
  6. 2021Graph Contrastive Learning Automatedcited by 287
  7. 2026Reinforcement Learning via Self-Distillationcited by 285
  8. 2023Sophia: A Scalable Stochastic Second-order Optimizer for Language Model Pre-trainingcited by 260
  9. 2024TextGrad: Automatic "Differentiation" via Textcited by 250
  10. 2023Reward Model Ensembles Help Mitigate Overoptimizationcited by 225
  11. 2022Online Decision Transformercited by 194
  12. 2024Rewards-in-Context: Multi-objective Alignment of Foundation Models with Dynamic Preference Adjustmentcited by 171
38 more
  1. 2022A Review of Safe Reinforcement Learning: Methods, Theory and Applicationscited by 169
  2. 2022How Powerful are Spectral Graph Neural Networkscited by 169
  3. 2021What Makes Multi-modal Learning Better than Single (Provably)cited by 151
  4. 2022DAGMA: Learning DAGs via M-matrices and a Log-Determinant Acyclicity Characterizationcited by 135
  5. 2022Training Data Influence Analysis and Estimation: A Surveycited by 134
  6. 2023Structured Pruning for Deep Convolutional Neural Networks: A surveycited by 122
  7. 2021OptiDICE: Offline Policy Optimization via Stationary Distribution Correction Estimationcited by 121
  8. 2022On the Convergence Rates of Policy Gradient Methodscited by 115
  9. 2023Offline RL with No OOD Actions: In-Sample Learning via Implicit Value Regularizationcited by 114
  10. 2021Dive into Deep Learningcited by 111
  11. 2024SOUL: Unlocking the Power of Second-Order Optimization for LLM Unlearningcited by 104
  12. 2023PPI++: Efficient Prediction-Powered Inferencecited by 103
  13. 2022Linear Adversarial Concept Erasurecited by 98
  14. 2023On the Stability of Iterative Retraining of Generative Models on their own Datacited by 98
  15. 2021Towards Principled Disentanglement for Domain Generalizationcited by 91
  16. 2023Filtering, Distillation, and Hard Negatives for Vision-Language Pre-Trainingcited by 91
  17. 2024Human Alignment of Large Language Models through Online Preference Optimisationcited by 90
  18. 2023Getting ViT in Shape: Scaling Laws for Compute-Optimal Model Designcited by 87
  19. 2022Fisher SAM: Information Geometry and Sharpness Aware Minimisationcited by 84
  20. 2022Tutorial on amortized optimizationcited by 83
  21. 2022Do Differentiable Simulators Give Better Policy Gradients?cited by 83
  22. 2025PlanGenLLMs: A Modern Survey of LLM Planning Capabilitiescited by 82
  23. 2024Marabou 2.0: A Versatile Formal Analyzer of Neural Networkscited by 81
  24. 2022Robustness to Unbounded Smoothness of Generalized SignSGDcited by 80
  25. 2021ConE: Cone Embeddings for Multi-Hop Reasoning over Knowledge Graphscited by 78
  26. 2024Panacea: Pareto Alignment via Preference Adaptation for LLMscited by 78
  27. 2024Optimal Flow Matching: Learning Straight Trajectories in Just One Stepcited by 74
  28. 2021Omnipredictorscited by 71
  29. 2023SafeDiffuser: Safe Planning with Diffusion Probabilistic Modelscited by 69
  30. 2023Who Should Predict? Exact Algorithms For Learning to Defer to Humanscited by 68
  31. 2025Archetypal SAE: Adaptive and Stable Dictionary Learning for Concept Extraction in Large Vision Modelscited by 67
  32. 2021Tackling System and Statistical Heterogeneity for Federated Learning with Adaptive Client Samplingcited by 66
  33. 2022Probable Domain Generalization via Quantile Risk Minimizationcited by 66
  34. 2022How Far I'll Go: Offline Goal-Conditioned Reinforcement Learning via f-Advantage Regressioncited by 65
  35. 2023Fixing by Mixing: A Recipe for Optimal Byzantine ML under Heterogeneitycited by 64
  36. 2022Active Learning by Feature Mixingcited by 63
  37. 2022Byzantine Machine Learning Made Easy by Resilient Averaging of Momentumscited by 63
  38. 2025Test-time regression: a unifying framework for designing sequence models with associative memorycited by 63

50 most cited of 2,479 All 2,479 (JSON)