Open Problem: The Oracle Complexity of Convex Optimization with Limited Memory
Not on the map. Why?
Abstract (arXiv)
We note that known methods achieving the optimal oracle complexity for first order convex optimization require quadratic memory, and ask whether this is necessary, and more broadly seek to characterize the minimax number of first order queries required to optimize a convex Lipschitz function subject to a memory constraint.
Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). First posted on arXiv 1 Jul 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2022: 1; 2023: 4; 2024: 2; 2025: 0; 2026: 1.
8 papers.
- 2022Efficient Convex Optimization Requires Superlinear Memorycited by 14
- 2024The I/O Complexity of Attention, or How Optimal is Flash Attention?cited by 6
- 2023Quadratic Memory is Necessary for Optimal Query Complexity in Convex Optimization: Center-of-Mass is Pareto-Optimalcited by 5
- 2023Improved Space Bounds for Learning with Expertscited by 5
- 2023Memory-Query Tradeoffs for Randomized Convex Optimizationcited by 4
- 2023Memory-Constrained Algorithms for Convex Optimization via Recursive Cutting-Planescited by 3
- 2024Gradient Descent is Pareto-Optimal in the Oracle Complexity and Memory Tradeoff for Feasibility Problemscited by 1
- 2026Stronger Memory-Query Tradeoffs for Convex Optimization: The Limitations of Subquadratic Memorycited by 0
- 2026Stronger Memory-Query Tradeoffs for Convex Optimization: The Limitations of Subquadratic Memory21 Jul 2026
- 2024Gradient Descent is Pareto-Optimal in the Oracle Complexity and Memory Tradeoff for Feasibility Problems10 Apr 2024
- 2024The I/O Complexity of Attention, or How Optimal is Flash Attention?12 Feb 2024
- 2023Memory-Query Tradeoffs for Randomized Convex Optimization21 Jun 2023
- 2023Memory-Constrained Algorithms for Convex Optimization via Recursive Cutting-Planes16 Jun 2023
- 2023Improved Space Bounds for Learning with Experts2 Mar 2023
- 2023Quadratic Memory is Necessary for Optimal Query Complexity in Convex Optimization: Center-of-Mass is Pareto-Optimal9 Feb 2023
- 2022Efficient Convex Optimization Requires Superlinear Memory29 Mar 2022