mlsanityData to 7 Oct 2026

Submodular + Concave

arXiv 2106.04769 ↗First posted 9 Jun 2021math.OC cs.DS cs.LGcited by 13

Not on the map. Why?

Abstract (arXiv)

It has been well established that first order optimization methods can converge to the maximal objective value of concave functions and provide constant factor approximation guarantees for (non-convex/non-concave) continuous submodular functions. In this work, we initiate the study of the maximization of functions of the form F(x) = G(x) +C(x) over a solvable convex body P, where G is a smooth DR-submodular function and C is a smooth concave function. This class of functions is a strict extension of both concave and continuous DR-submodular functions for which no theoretical guarantee is known. We provide a suite of Frank-Wolfe style algorithms, which, depending on the nature of the objective function (i.e., if G and C are monotone or not, and non-negative or not) and on the nature of the set P (i.e., whether it is downward closed or not), provide 1-1/e, 1/e, or 1/2 approximation guarantees. We then use our algorithms to get a framework to smoothly interpolate between choosing a diverse set of elements from a given ground set (corresponding to the mode of a determinantal point process) and choosing a clustered set of elements (corresponding to the maxima of a suitable concave function). Additionally, we apply our algorithms to various functions in the above class (DR-submodular + concave) in both constrained and unconstrained settings, and show that our algorithms consistently outperform natural baselines.

Key facts. Cited by 13 papers in the map (data through 7 Oct 2026). Builds on 41 of its 68 references that are in the map. First posted on arXiv 9 Jun 2021.

Builds on

41 of 68 references.

References · 41

  1. 2018Neural Tangent Kernel: Convergence and Generalization in Neural Networkscited by 2,597
  2. 2018Gradient Descent Provably Optimizes Over-parameterized Neural Networkscited by 655
  3. 2014Convex Optimization: Algorithms and Complexitycited by 569
  4. 2018Learning and Generalization in Overparameterized Neural Networks, Going Beyond Two Layerscited by 340
  5. 2015Escaping From Saddle Points --- Online Stochastic Gradient for Tensor Decompositioncited by 241
  6. 2018Log-concave sampling: Metropolis-Hastings algorithms are fastcited by 117
  7. 2014Guaranteed Matrix Completion via Non-convex Factorizationcited by 81
  8. 2018Gradient Descent with Random Initialization: Fast Global Convergence for Nonconvex Phase Retrievalcited by 71
  9. 2016Restricted Strong Convexity Implies Weak Submodularitycited by 51
  10. 2014Non-convex Robust PCAcited by 41
  11. 2018Online Continuous Submodular Maximizationcited by 35
  12. 2015On Graduated Optimization for Stochastic Non-Convex Problemscited by 34
29 more
  1. 2017Gradient Methods for Submodular Maximizationcited by 33
  2. 2019Online Continuous Submodular Maximization: From Full-Information to Bandit Feedbackcited by 33
  3. 2014Near-Optimally Teaching the Crowd to Classifycited by 32
  4. 2016Guaranteed Non-convex Optimization: Submodular Maximization over Continuous Domainscited by 31
  5. 2013Optimal approximation for submodular and supermodular optimization with bounded curvaturecited by 29
  6. 2015When Are Nonconvex Problems Not Scary?cited by 27
  7. 2016Monte Carlo Markov Chain Algorithms for Sampling Strongly Rayleigh Distributions and Determinantal Point Processescited by 24
  8. 2017Continuous DR-submodular Maximization: Structure and Algorithmscited by 24
  9. 2017Conditional Gradient Method for Stochastic Submodular Maximization: Closing the Gapcited by 21
  10. 2014Distributed Submodular Maximizationcited by 20
  11. 2019Submodular Maximization Beyond Non-negativity: Guarantees, Fast Algorithms, and Applicationscited by 20
  12. 2019Bayesian experimental design using regularized determinantal point processescited by 17
  13. 2020Regularized Submodular Maximization at Scalecited by 15
  14. 2018Decentralized Submodular Maximization: Bridging Discrete and Continuous Settingscited by 13
  15. 2018Guess Free Maximization of Submodular and Linear Sumscited by 13
  16. 2018Optimal Algorithms for Continuous Non-monotone Submodular and DR-Submodular Maximizationcited by 12
  17. 2020Submodularity in Action: From Machine Learning to Signal Processing Applicationscited by 12
  18. 2018Learning Restricted Boltzmann Machines via Influence Maximizationcited by 10
  19. 2017Streaming Weak Submodularity: Interpreting Neural Networks on the Flycited by 9
  20. 2019Parallel Algorithm for Non-Monotone DR-Submodular Maximizationcited by 9
  21. 2019Online Continuous DR-Submodular Maximization with Long-Term Budget Constraintscited by 9
  22. 2017Robust Budget Allocation via Continuous Submodular Functionscited by 8
  23. 2018Unconstrained Submodular Maximization with Constant Adaptive Complexitycited by 8
  24. 2019Stochastic Conditional Gradient++cited by 8
  25. 2019Flexible Modeling of Diversity with Strongly Log-Concave Distributionscited by 6
  26. 2015Fast Mixing for Discrete Point Processescited by 3
  27. 2015Globally solving Non-Convex Quadratic Programs via Linear Integer Programming techniquescited by 3
  28. 2018Optimal DR-Submodular Maximization and Applications to Provable Mean Field Inferencecited by 2
  29. 2020Online DR-Submodular Maximization with Stochastic Cumulative Constraintscited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 1; 2022: 5; 2023: 0; 2024: 3; 2025: 2; 2026: 2.

13 papers.

Sort: