Submodular Framework for Structured-Sparse Optimal Transport
Not on the map. Why?
Abstract (arXiv)
Unbalanced optimal transport (UOT) has recently gained much attention due to its flexible framework for handling un-normalized measures and its robustness properties. In this work, we explore learning (structured) sparse transport plans in the UOT setting, i.e., transport plans have an upper bound on the number of non-sparse entries in each column (structured sparse pattern) or in the whole plan (general sparse pattern). We propose novel sparsity-constrained UOT formulations building on the recently explored maximum mean discrepancy based UOT. We show that the proposed optimization problem is equivalent to the maximization of a weakly submodular function over a uniform matroid or a partition matroid. We develop efficient gradient-based discrete greedy algorithms and provide the corresponding theoretical guarantees. Empirically, we observe that our proposed greedy algorithms select a diverse support set and we illustrate the efficacy of the proposed approach in various applications.
Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Builds on 37 of its 58 references that are in the map. First posted on arXiv 7 Jun 2024.
Builds on
37 of 58 references.
References · 37
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2017Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layercited by 3,509
- 2013Sinkhorn Distances: Lightspeed Computation of Optimal Transportation Distancescited by 2,316
- 2015Optimal Transport for Domain Adaptationcited by 463
- 2016Kernel Mean Embedding of Distributions: A Review and Beyondcited by 364
- 2013Learning Factored Representations in a Deep Mixture of Expertscited by 278
- 2017MMD GAN: Towards Deeper Understanding of Moment Matching Networkcited by 254
- 2022Unified Scaling Laws for Routed Language Modelscited by 253
- 2015Learning with a Wasserstein Losscited by 196
- 2020SimAlign: High Quality Word Alignments without Parallel Training Data using Static and Contextualized Embeddingscited by 156
- 2015Optimal Entropy-Transport problems and a new Hellinger-Kantorovich distance between positive measurescited by 139
- 2021Unbalanced minibatch Optimal Transport; applications to Domain Adaptationcited by 125
25 more
- 2018Gromov-Wasserstein Alignment of Word Embedding Spacescited by 122
- 2014Lazier Than Lazy Greedycited by 99
- 2019Learning with minibatch Wasserstein : asymptotic and gradient propertiescited by 87
- 2020Robust Optimal Transport with Applications in Generative Modeling and Domain Adaptationcited by 87
- 2017Smooth and Sparse Optimal Transportcited by 83
- 2016Restricted Strong Convexity Implies Weak Submodularitycited by 52
- 2019Multi-Hop Paragraph Retrieval for Open-Domain Question Answeringcited by 34
- 2022Sparsity-Constrained Optimal Transportcited by 32
- 2017Structured Optimal Transportcited by 31
- 2021Generalized Kernel Thinningcited by 29
- 2020Rationalizing Text Matching: Learning Sparse Alignments via Optimal Transportcited by 20
- 2017Quadratically-Regularized Optimal Transport on Graphscited by 19
- 2021On Transportation of Mini-batches: A Hierarchical Approachcited by 16
- 2021QA-Align: Representing Cross-Text Content Overlap by Aligning Question-Answer Propositionscited by 16
- 2016Tsallis Regularized Optimal Transport and Ecological Inferencecited by 15
- 2020Geometry-aware Domain Adaptation for Unsupervised Alignment of Word Embeddingscited by 14
- 2017Weakly Submodular Maximization Beyond Cardinality Constraints: Does Randomization Help Greedy?cited by 13
- 2021SPOT: A framework for selection of prototypes using optimal transportcited by 13
- 2020MMD-Regularized Unbalanced Optimal Transportcited by 8
- 2020Statistical Optimal Transport posed as Learning Kernel Embeddingcited by 7
- 2022Riemannian block SPD coupling manifold and its application to optimal transportcited by 7
- 2020Efficient Robust Optimal Transport with Application to Multi-Label Classificationcited by 6
- 2023Consistent Optimal Transport with Empirical Conditional Measurescited by 6
- 2023Unbalanced Optimal Transport for Unbalanced Word Alignmentcited by 6
- 2019Kernel Mean Matching for Content Addressability of GANscited by 5
Built on by
Citing papers per year: 2024: 1; 2025: 0; 2026: 4.
5 papers.
- 2024A Riemannian Approach to Ground Metric Learning for Optimal Transportcited by 3
- 2026A Riemannian Approach to Low-Rank Optimal Transportcited by 1
- 2026Optimal Transport under Group Fairness Constraintscited by 0
- 2026Minibatch Selection for Language Models via Partition Matroid Constrained Gradient Matchingcited by 0
- 2026Probabilistic Multi-Source Data Selection via Learnable Categorical Priors: Variance Reduction and Guaranteed Derandomizationcited by 0
- 2026Probabilistic Multi-Source Data Selection via Learnable Categorical Priors: Variance Reduction and Guaranteed Derandomization10 Oct 2026
- 2026A Riemannian Approach to Low-Rank Optimal Transport10 Jun 2026
- 2026Minibatch Selection for Language Models via Partition Matroid Constrained Gradient Matching6 Jun 2026
- 2026Optimal Transport under Group Fairness Constraints12 Jan 2026
- 2024A Riemannian Approach to Ground Metric Learning for Optimal Transport16 Sep 2024