Submodular + Concave
Not on the map. Why?
Abstract (arXiv)
It has been well established that first order optimization methods can converge to the maximal objective value of concave functions and provide constant factor approximation guarantees for (non-convex/non-concave) continuous submodular functions. In this work, we initiate the study of the maximization of functions of the form F(x) = G(x) +C(x) over a solvable convex body P, where G is a smooth DR-submodular function and C is a smooth concave function. This class of functions is a strict extension of both concave and continuous DR-submodular functions for which no theoretical guarantee is known. We provide a suite of Frank-Wolfe style algorithms, which, depending on the nature of the objective function (i.e., if G and C are monotone or not, and non-negative or not) and on the nature of the set P (i.e., whether it is downward closed or not), provide 1-1/e, 1/e, or 1/2 approximation guarantees. We then use our algorithms to get a framework to smoothly interpolate between choosing a diverse set of elements from a given ground set (corresponding to the mode of a determinantal point process) and choosing a clustered set of elements (corresponding to the maxima of a suitable concave function). Additionally, we apply our algorithms to various functions in the above class (DR-submodular + concave) in both constrained and unconstrained settings, and show that our algorithms consistently outperform natural baselines.
Key facts. Cited by 13 papers in the map (data through 7 Oct 2026). Builds on 41 of its 68 references that are in the map. First posted on arXiv 9 Jun 2021.
Builds on
41 of 68 references.
References · 41
- 2018Neural Tangent Kernel: Convergence and Generalization in Neural Networkscited by 2,597
- 2018Gradient Descent Provably Optimizes Over-parameterized Neural Networkscited by 655
- 2014Convex Optimization: Algorithms and Complexitycited by 569
- 2018Learning and Generalization in Overparameterized Neural Networks, Going Beyond Two Layerscited by 340
- 2015Escaping From Saddle Points --- Online Stochastic Gradient for Tensor Decompositioncited by 241
- 2018Log-concave sampling: Metropolis-Hastings algorithms are fastcited by 117
- 2014Guaranteed Matrix Completion via Non-convex Factorizationcited by 81
- 2018Gradient Descent with Random Initialization: Fast Global Convergence for Nonconvex Phase Retrievalcited by 71
- 2016Restricted Strong Convexity Implies Weak Submodularitycited by 51
- 2014Non-convex Robust PCAcited by 41
- 2018Online Continuous Submodular Maximizationcited by 35
- 2015On Graduated Optimization for Stochastic Non-Convex Problemscited by 34
29 more
- 2017Gradient Methods for Submodular Maximizationcited by 33
- 2019Online Continuous Submodular Maximization: From Full-Information to Bandit Feedbackcited by 33
- 2014Near-Optimally Teaching the Crowd to Classifycited by 32
- 2016Guaranteed Non-convex Optimization: Submodular Maximization over Continuous Domainscited by 31
- 2013Optimal approximation for submodular and supermodular optimization with bounded curvaturecited by 29
- 2015When Are Nonconvex Problems Not Scary?cited by 27
- 2016Monte Carlo Markov Chain Algorithms for Sampling Strongly Rayleigh Distributions and Determinantal Point Processescited by 24
- 2017Continuous DR-submodular Maximization: Structure and Algorithmscited by 24
- 2017Conditional Gradient Method for Stochastic Submodular Maximization: Closing the Gapcited by 21
- 2014Distributed Submodular Maximizationcited by 20
- 2019Submodular Maximization Beyond Non-negativity: Guarantees, Fast Algorithms, and Applicationscited by 20
- 2019Bayesian experimental design using regularized determinantal point processescited by 17
- 2020Regularized Submodular Maximization at Scalecited by 15
- 2018Decentralized Submodular Maximization: Bridging Discrete and Continuous Settingscited by 13
- 2018Guess Free Maximization of Submodular and Linear Sumscited by 13
- 2018Optimal Algorithms for Continuous Non-monotone Submodular and DR-Submodular Maximizationcited by 12
- 2020Submodularity in Action: From Machine Learning to Signal Processing Applicationscited by 12
- 2018Learning Restricted Boltzmann Machines via Influence Maximizationcited by 10
- 2017Streaming Weak Submodularity: Interpreting Neural Networks on the Flycited by 9
- 2019Parallel Algorithm for Non-Monotone DR-Submodular Maximizationcited by 9
- 2019Online Continuous DR-Submodular Maximization with Long-Term Budget Constraintscited by 9
- 2017Robust Budget Allocation via Continuous Submodular Functionscited by 8
- 2018Unconstrained Submodular Maximization with Constant Adaptive Complexitycited by 8
- 2019Stochastic Conditional Gradient++cited by 8
- 2019Flexible Modeling of Diversity with Strongly Log-Concave Distributionscited by 6
- 2015Fast Mixing for Discrete Point Processescited by 3
- 2015Globally solving Non-Convex Quadratic Programs via Linear Integer Programming techniquescited by 3
- 2018Optimal DR-Submodular Maximization and Applications to Provable Mean Field Inferencecited by 2
- 2020Online DR-Submodular Maximization with Stochastic Cumulative Constraintscited by 2
Built on by
Citing papers per year: 2021: 1; 2022: 5; 2023: 0; 2024: 3; 2025: 2; 2026: 2.
13 papers.
Sort:
- 2022Stochastic Continuous Submodular Maximization: Boosting via Non-oblivious Functioncited by 21
- 2022Resolving the Approximability of Offline and Online Non-monotone DR-Submodular Maximization over General Convex Setscited by 14
- 2024From Linear to Linearizable Optimization: A Novel Framework with Applications to Stationary and Non-stationary DR-submodular Optimizationcited by 8
- 2025Decentralized Projection-free Online Upper-Linearizable Optimization with Applications to DR-Submodular Optimizationcited by 7
- 2022Lyapunov function approach for approximation algorithm design and analysis: with applications in submodular maximizationcited by 6
- 2022Communication-Efficient Decentralized Online Continuous DR-Submodular Maximizationcited by 6
- 2021Minimax Optimization: The Case of Convex-Submodularcited by 5
- 2024Unified Projection-Free Algorithms for Adversarial DR-Submodular Optimizationcited by 5
- 2025G"odel Test: Can Large Language Models Solve Easy Conjectures?cited by 5
- 2022Online Learning for Non-monotone Submodular Maximization: From Full Information to Bandit Feedbackcited by 3
- 2024Bridging the Gap Between General and Down-Closed Convex Sets in Submodular Maximizationcited by 1
- 2026γ-weakly θ-up-concavity: A Unified Framework for Non-Convex Optimization Beyond DR-Submodular and OSS Functionscited by 0
- 2026Dec-BFTRL: Squre-Root Regret for Decentralized Online Upper-Linearizable Optimization under Separation Access with Application to Continuous Submodular Maximization31 Aug 2026
- 2026γ-weakly θ-up-concavity: A Unified Framework for Non-Convex Optimization Beyond DR-Submodular and OSS Functions13 Feb 2026
- 2025G"odel Test: Can Large Language Models Solve Easy Conjectures?22 Sep 2025
- 2025Decentralized Projection-free Online Upper-Linearizable Optimization with Applications to DR-Submodular Optimization30 Jan 2025
- 2024From Linear to Linearizable Optimization: A Novel Framework with Applications to Stationary and Non-stationary DR-submodular Optimization27 Apr 2024
- 2024Unified Projection-Free Algorithms for Adversarial DR-Submodular Optimization15 Mar 2024
- 2024Bridging the Gap Between General and Down-Closed Convex Sets in Submodular Maximization17 Jan 2024
- 2022Resolving the Approximability of Offline and Online Non-monotone DR-Submodular Maximization over General Convex Sets12 Oct 2022
- 2022Communication-Efficient Decentralized Online Continuous DR-Submodular Maximization18 Aug 2022
- 2022Online Learning for Non-monotone Submodular Maximization: From Full Information to Bandit Feedback16 Aug 2022
- 2022Lyapunov function approach for approximation algorithm design and analysis: with applications in submodular maximization25 May 2022
- 2022Stochastic Continuous Submodular Maximization: Boosting via Non-oblivious Function3 Jan 2022
1 more
- 2021Minimax Optimization: The Case of Convex-Submodular1 Nov 2021
- 2022Stochastic Continuous Submodular Maximization: Boosting via Non-oblivious Functioncited by 21
- 2022Resolving the Approximability of Offline and Online Non-monotone DR-Submodular Maximization over General Convex Setscited by 14
- 2024From Linear to Linearizable Optimization: A Novel Framework with Applications to Stationary and Non-stationary DR-submodular Optimizationcited by 8
- 2025Decentralized Projection-free Online Upper-Linearizable Optimization with Applications to DR-Submodular Optimizationcited by 7
- 2022Lyapunov function approach for approximation algorithm design and analysis: with applications in submodular maximizationcited by 6
- 2022Communication-Efficient Decentralized Online Continuous DR-Submodular Maximizationcited by 6
- 2021Minimax Optimization: The Case of Convex-Submodularcited by 5
- 2024Unified Projection-Free Algorithms for Adversarial DR-Submodular Optimizationcited by 5
- 2025G"odel Test: Can Large Language Models Solve Easy Conjectures?cited by 5
- 2022Online Learning for Non-monotone Submodular Maximization: From Full Information to Bandit Feedbackcited by 3
- 2024Bridging the Gap Between General and Down-Closed Convex Sets in Submodular Maximizationcited by 1
- 2026γ-weakly θ-up-concavity: A Unified Framework for Non-Convex Optimization Beyond DR-Submodular and OSS Functionscited by 0
12 most cited of 13 All 13 (JSON)
- 2026Dec-BFTRL: Squre-Root Regret for Decentralized Online Upper-Linearizable Optimization under Separation Access with Application to Continuous Submodular Maximization31 Aug 2026
- 2026γ-weakly θ-up-concavity: A Unified Framework for Non-Convex Optimization Beyond DR-Submodular and OSS Functions13 Feb 2026
- 2025G"odel Test: Can Large Language Models Solve Easy Conjectures?22 Sep 2025
- 2025Decentralized Projection-free Online Upper-Linearizable Optimization with Applications to DR-Submodular Optimization30 Jan 2025
- 2024From Linear to Linearizable Optimization: A Novel Framework with Applications to Stationary and Non-stationary DR-submodular Optimization27 Apr 2024
- 2024Unified Projection-Free Algorithms for Adversarial DR-Submodular Optimization15 Mar 2024
- 2024Bridging the Gap Between General and Down-Closed Convex Sets in Submodular Maximization17 Jan 2024
- 2022Resolving the Approximability of Offline and Online Non-monotone DR-Submodular Maximization over General Convex Sets12 Oct 2022
- 2022Communication-Efficient Decentralized Online Continuous DR-Submodular Maximization18 Aug 2022
- 2022Online Learning for Non-monotone Submodular Maximization: From Full Information to Bandit Feedback16 Aug 2022
- 2022Lyapunov function approach for approximation algorithm design and analysis: with applications in submodular maximization25 May 2022
- 2022Stochastic Continuous Submodular Maximization: Boosting via Non-oblivious Function3 Jan 2022
12 newest of 13 All 13 (JSON)