A Faster Cutting Plane Method and its Implications for Combinatorial and Convex Optimization
Not on the map. Why?
Abstract (arXiv)
We improve upon the running time for finding a point in a convex set given a separation oracle. In particular, given a separation oracle for a convex set Ksubset ℝn contained in a box of radius R, we show how to either find a point in K or prove that K does not contain a ball of radius ε using an expected O(nlog(nR/ε)) oracle evaluations and additional time O(n3logO(1)(nR/ε)). This matches the oracle complexity and improves upon the O(nω+1log(nR/ε)) additional time of the previous fastest algorithm achieved over 25 years ago by Vaidya for the current matrix multiplication constant ω<2.373 when R/ε=nO(1). Using a mix of standard reductions and new techniques, our algorithm yields improved runtimes for solving classic problems in continuous and combinatorial optimization: Submodular Minimization: Our weakly and strongly polynomial time algorithms have runtimes of O(n2log nM·EO+n3logO(1)nM) and O(n3log2 n·EO+n4logO(1)n), improving upon the previous best of O((n4EO+n5)log M) and O(n5EO+n6). Matroid Intersection: Our runtimes are O(nrTranklog nlog (nM) +n3logO(1)(nM)) and O(n2log (nM) Tind+n3 logO(1) (nM)), achieving the first quadratic bound on the query complexity for the independence and rank oracles. In the unweighted case, this is the first improvement since 1986 for independence oracle. Submodular Flow: Our runtime is O(n2log nCU·EO+n3logO(1)nCU), improving upon the previous bests from 15 years ago roughly by a factor of O(n4). Semidefinite Programming: Our runtime is tildeO(n(n2+mω+S)), improving upon the previous best of tildeO(n(nω+mω+S)) for the regime where the number of nonzeros S is small.
Key facts. Cited by 50 papers in the map (data through 7 Oct 2026). First posted on arXiv 20 Aug 2015.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 8; 2022: 7; 2023: 12; 2024: 11; 2025: 7; 2026: 5.
50 papers.
Sort:
- 2021Training Quantum Embedding Kernels on Near-Term Quantum Computerscited by 69
- 2021Training Multi-Layer Over-Parametrized Neural Network in Subquadratic Timecited by 62
- 2022Submodularity In Machine Learning and Artificial Intelligencecited by 37
- 2023A Fast Optimization View: Reformulating Single Layer Attention in LLM Based on Tensor and SVM Trick, and Solving It in Matrix Multiplication Timecited by 30
- 2021Efficient Projection-Free Online Convex Optimization with Membership Oraclecited by 29
- 2022Discrete-Convex-Analysis-Based Framework for Warm-Starting Algorithms with Predictionscited by 16
- 2023A General Algorithm for Solving Rank-one Matrix Sensingcited by 15
- 2022Efficient Convex Optimization Requires Superlinear Memorycited by 14
- 2021An Introduction to Johnson-Lindenstrauss Transformscited by 10
- 2022Exploiting the Curvature of Feasible Sets for Faster Projection-Free Online Learningcited by 10
- 2021Minimax Optimization with Smooth Algorithmic Adversariescited by 8
- 2023A Survey on the Densest Subgraph Problem and Its Variantscited by 8
38 more
- 2023Submodular Minimax Optimization: Finding Effective Setscited by 7
- 2023Feature Adaptation for Sparse Linear Regressioncited by 6
- 2023Quadratic Memory is Necessary for Optimal Query Complexity in Convex Optimization: Center-of-Mass is Pareto-Optimalcited by 5
- 2024An invitation to the sample complexity of quantum hypothesis testingcited by 5
- 2023Agnostic proper learning of monotone functions: beyond the black-box correction barriercited by 4
- 2023Accelerated Quasi-Newton Proximal Extragradient: Faster Rate for Smooth Convex Optimizationcited by 4
- 2023Memory-Query Tradeoffs for Randomized Convex Optimizationcited by 4
- 2024Computing Optimal Regularizers for Online Linear Optimizationcited by 4
- 2025The Structural Complexity of Matrix-Vector Multiplicationcited by 4
- 2021Decomposable Submodular Function Minimization via Maximum Flowcited by 3
- 2023Rethinking Warm-Starts with Predictions: Learning Predictions Close to Sets of Optimal Solutions for Faster L-/L^natural-Convex Function Minimizationcited by 3
- 2023Faster Discrete Convex Function Minimization with Predictions: The M-Convex Casecited by 3
- 2023Memory-Constrained Algorithms for Convex Optimization via Recursive Cutting-Planescited by 3
- 2024Closing the Computational-Query Depth Gap in Parallel Stochastic Convex Optimizationcited by 3
- 2024Private Geometric Mediancited by 3
- 2025Quantum Algorithms for Bandits with Knapsacks with Improved Regret and Time Complexitiescited by 2
- 2025A Simple, Optimal and Efficient Algorithm for Online Exp-Concave Optimizationcited by 2
- 2026Efficient Online Inverse Optimization with O(d) Regretcited by 2
- 2021A Hybrid Quantum-Classical Hamiltonian Learning Algorithmcited by 1
- 2022Polynomial-time Sparse Measure Recovery: From Mean Field Theory to Algorithm Designcited by 1
- 2022Online Nonsubmodular Minimization with Delayed Costs: From Full Information to Bandit Feedbackcited by 1
- 2024Quantum Speedup for Spectral Approximation of Kronecker Productscited by 1
- 2024Gradient Descent is Pareto-Optimal in the Oracle Complexity and Memory Tradeoff for Feasibility Problemscited by 1
- 2024Binary Hypothesis Testing for Softmax Models and Leverage Score Modelscited by 1
- 2024Solving 0-1 Integer Programs with Unknown Knapsack Constraints Using Membership Oraclescited by 1
- 2024Active Learning of Deep Neural Networks via Gradient-Free Cutting Planescited by 1
- 2025Characterizing the Accuracy-Communication-Privacy Trade-off in Distributed Stochastic Convex Optimizationcited by 1
- 2025Differentially Private Bilevel Optimization: Efficient Algorithms with Near-Optimal Ratescited by 1
- 2025Differentially Private Synthetic Graphs Preserving Triangle-Motif Cutscited by 1
- 2021Identifiability of AMP chain graph modelscited by 0
- 2022Decomposable Non-Smooth Convex Optimization with Nearly-Linear Gradient Oracle Complexitycited by 0
- 2024Logarithmic Regret for Unconstrained Submodular Maximization Stochastic Banditcited by 0
- 2024Reconstructing Deep Neural Networks: Unleashing the Optimization Potential of Natural Gradient Descentcited by 0
- 2025On Quantum Perceptron Learning via Quantum Searchcited by 0
- 2026Matroid Algorithms Under Size-Sensitive Independence Oraclescited by 0
- 2026Beyond Averaging in John Ellipsoid Approximation: High-Accuracy Algorithms in the Leverage-Score Modelcited by 0
- 2026Fast, Parallel, Query-Efficient Binary Classificationcited by 0
- 2026Stronger Memory-Query Tradeoffs for Convex Optimization: The Limitations of Subquadratic Memorycited by 0
- 2026Efficient Online Inverse Optimization with O(d) Regret11 Sep 2026
- 2026Stronger Memory-Query Tradeoffs for Convex Optimization: The Limitations of Subquadratic Memory21 Jul 2026
- 2026Fast, Parallel, Query-Efficient Binary Classification5 Jul 2026
- 2026Beyond Averaging in John Ellipsoid Approximation: High-Accuracy Algorithms in the Leverage-Score Model18 Jun 2026
- 2026Matroid Algorithms Under Size-Sensitive Independence Oracles30 Apr 2026
- 2025A Simple, Optimal and Efficient Algorithm for Online Exp-Concave Optimization29 Dec 2025
- 2025Differentially Private Synthetic Graphs Preserving Triangle-Motif Cuts20 Jul 2025
- 2025Quantum Algorithms for Bandits with Knapsacks with Improved Regret and Time Complexities6 Jul 2025
- 2025Differentially Private Bilevel Optimization: Efficient Algorithms with Near-Optimal Rates15 Jun 2025
- 2025On Quantum Perceptron Learning via Quantum Search21 Mar 2025
- 2025The Structural Complexity of Matrix-Vector Multiplication28 Feb 2025
- 2025Characterizing the Accuracy-Communication-Privacy Trade-off in Distributed Stochastic Convex Optimization6 Jan 2025
38 more
- 2024Reconstructing Deep Neural Networks: Unleashing the Optimization Potential of Natural Gradient Descent10 Dec 2024
- 2024Computing Optimal Regularizers for Online Linear Optimization22 Oct 2024
- 2024Logarithmic Regret for Unconstrained Submodular Maximization Stochastic Bandit11 Oct 2024
- 2024Active Learning of Deep Neural Networks via Gradient-Free Cutting Planes3 Oct 2024
- 2024Private Geometric Median11 Jun 2024
- 2024Closing the Computational-Query Depth Gap in Parallel Stochastic Convex Optimization11 Jun 2024
- 2024Solving 0-1 Integer Programs with Unknown Knapsack Constraints Using Membership Oracles23 May 2024
- 2024Binary Hypothesis Testing for Softmax Models and Leverage Score Models9 May 2024
- 2024Gradient Descent is Pareto-Optimal in the Oracle Complexity and Memory Tradeoff for Feasibility Problems10 Apr 2024
- 2024An invitation to the sample complexity of quantum hypothesis testing26 Mar 2024
- 2024Quantum Speedup for Spectral Approximation of Kronecker Products10 Feb 2024
- 2023A Fast Optimization View: Reformulating Single Layer Attention in LLM Based on Tensor and SVM Trick, and Solving It in Matrix Multiplication Time14 Sep 2023
- 2023Memory-Query Tradeoffs for Randomized Convex Optimization21 Jun 2023
- 2023Memory-Constrained Algorithms for Convex Optimization via Recursive Cutting-Planes16 Jun 2023
- 2023Faster Discrete Convex Function Minimization with Predictions: The M-Convex Case9 Jun 2023
- 2023Accelerated Quasi-Newton Proximal Extragradient: Faster Rate for Smooth Convex Optimization3 Jun 2023
- 2023Submodular Minimax Optimization: Finding Effective Sets26 May 2023
- 2023Feature Adaptation for Sparse Linear Regression26 May 2023
- 2023Agnostic proper learning of monotone functions: beyond the black-box correction barrier5 Apr 2023
- 2023A Survey on the Densest Subgraph Problem and Its Variants25 Mar 2023
- 2023A General Algorithm for Solving Rank-one Matrix Sensing22 Mar 2023
- 2023Quadratic Memory is Necessary for Optimal Query Complexity in Convex Optimization: Center-of-Mass is Pareto-Optimal9 Feb 2023
- 2023Rethinking Warm-Starts with Predictions: Learning Predictions Close to Sets of Optimal Solutions for Faster L-/L^natural-Convex Function Minimization2 Feb 2023
- 2022Decomposable Non-Smooth Convex Optimization with Nearly-Linear Gradient Oracle Complexity7 Aug 2022
- 2022Exploiting the Curvature of Feasible Sets for Faster Projection-Free Online Learning23 May 2022
- 2022Discrete-Convex-Analysis-Based Framework for Warm-Starting Algorithms with Predictions20 May 2022
- 2022Online Nonsubmodular Minimization with Delayed Costs: From Full Information to Bandit Feedback15 May 2022
- 2022Polynomial-time Sparse Measure Recovery: From Mean Field Theory to Algorithm Design16 Apr 2022
- 2022Efficient Convex Optimization Requires Superlinear Memory29 Mar 2022
- 2022Submodularity In Machine Learning and Artificial Intelligence31 Jan 2022
- 2021Training Multi-Layer Over-Parametrized Neural Network in Subquadratic Time14 Dec 2021
- 2021Efficient Projection-Free Online Convex Optimization with Membership Oracle10 Nov 2021
- 2021Identifiability of AMP chain graph models17 Jun 2021
- 2021Minimax Optimization with Smooth Algorithmic Adversaries2 Jun 2021
- 2021Training Quantum Embedding Kernels on Near-Term Quantum Computers5 May 2021
- 2021Decomposable Submodular Function Minimization via Maximum Flow5 Mar 2021
- 2021A Hybrid Quantum-Classical Hamiltonian Learning Algorithm1 Mar 2021
- 2021An Introduction to Johnson-Lindenstrauss Transforms28 Feb 2021
- 2021Training Quantum Embedding Kernels on Near-Term Quantum Computerscited by 69
- 2021Training Multi-Layer Over-Parametrized Neural Network in Subquadratic Timecited by 62
- 2022Submodularity In Machine Learning and Artificial Intelligencecited by 37
- 2023A Fast Optimization View: Reformulating Single Layer Attention in LLM Based on Tensor and SVM Trick, and Solving It in Matrix Multiplication Timecited by 30
- 2021Efficient Projection-Free Online Convex Optimization with Membership Oraclecited by 29
- 2022Discrete-Convex-Analysis-Based Framework for Warm-Starting Algorithms with Predictionscited by 16
- 2023A General Algorithm for Solving Rank-one Matrix Sensingcited by 15
- 2022Efficient Convex Optimization Requires Superlinear Memorycited by 14
- 2021An Introduction to Johnson-Lindenstrauss Transformscited by 10
- 2022Exploiting the Curvature of Feasible Sets for Faster Projection-Free Online Learningcited by 10
- 2021Minimax Optimization with Smooth Algorithmic Adversariescited by 8
- 2023A Survey on the Densest Subgraph Problem and Its Variantscited by 8
12 most cited of 50 All 50 (JSON)
- 2026Efficient Online Inverse Optimization with O(d) Regret11 Sep 2026
- 2026Stronger Memory-Query Tradeoffs for Convex Optimization: The Limitations of Subquadratic Memory21 Jul 2026
- 2026Fast, Parallel, Query-Efficient Binary Classification5 Jul 2026
- 2026Beyond Averaging in John Ellipsoid Approximation: High-Accuracy Algorithms in the Leverage-Score Model18 Jun 2026
- 2026Matroid Algorithms Under Size-Sensitive Independence Oracles30 Apr 2026
- 2025A Simple, Optimal and Efficient Algorithm for Online Exp-Concave Optimization29 Dec 2025
- 2025Differentially Private Synthetic Graphs Preserving Triangle-Motif Cuts20 Jul 2025
- 2025Quantum Algorithms for Bandits with Knapsacks with Improved Regret and Time Complexities6 Jul 2025
- 2025Differentially Private Bilevel Optimization: Efficient Algorithms with Near-Optimal Rates15 Jun 2025
- 2025On Quantum Perceptron Learning via Quantum Search21 Mar 2025
- 2025The Structural Complexity of Matrix-Vector Multiplication28 Feb 2025
- 2025Characterizing the Accuracy-Communication-Privacy Trade-off in Distributed Stochastic Convex Optimization6 Jan 2025
12 newest of 50 All 50 (JSON)