mlsanityData to 14 Oct 2026

Submodular Framework for Structured-Sparse Optimal Transport

arXiv 2406.04914 ↗First posted 7 Jun 2024cs.LGcited by 5

Not on the map. Why?

Abstract (arXiv)

Unbalanced optimal transport (UOT) has recently gained much attention due to its flexible framework for handling un-normalized measures and its robustness properties. In this work, we explore learning (structured) sparse transport plans in the UOT setting, i.e., transport plans have an upper bound on the number of non-sparse entries in each column (structured sparse pattern) or in the whole plan (general sparse pattern). We propose novel sparsity-constrained UOT formulations building on the recently explored maximum mean discrepancy based UOT. We show that the proposed optimization problem is equivalent to the maximization of a weakly submodular function over a uniform matroid or a partition matroid. We develop efficient gradient-based discrete greedy algorithms and provide the corresponding theoretical guarantees. Empirically, we observe that our proposed greedy algorithms select a diverse support set and we illustrate the efficacy of the proposed approach in various applications.

Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Builds on 37 of its 58 references that are in the map. First posted on arXiv 7 Jun 2024.

Builds on

37 of 58 references.

References · 37

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2017Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layercited by 3,509
  3. 2013Sinkhorn Distances: Lightspeed Computation of Optimal Transportation Distancescited by 2,316
  4. 2015Optimal Transport for Domain Adaptationcited by 463
  5. 2016Kernel Mean Embedding of Distributions: A Review and Beyondcited by 364
  6. 2013Learning Factored Representations in a Deep Mixture of Expertscited by 278
  7. 2017MMD GAN: Towards Deeper Understanding of Moment Matching Networkcited by 254
  8. 2022Unified Scaling Laws for Routed Language Modelscited by 253
  9. 2015Learning with a Wasserstein Losscited by 196
  10. 2020SimAlign: High Quality Word Alignments without Parallel Training Data using Static and Contextualized Embeddingscited by 156
  11. 2015Optimal Entropy-Transport problems and a new Hellinger-Kantorovich distance between positive measurescited by 139
  12. 2021Unbalanced minibatch Optimal Transport; applications to Domain Adaptationcited by 125
25 more
  1. 2018Gromov-Wasserstein Alignment of Word Embedding Spacescited by 122
  2. 2014Lazier Than Lazy Greedycited by 99
  3. 2019Learning with minibatch Wasserstein : asymptotic and gradient propertiescited by 87
  4. 2020Robust Optimal Transport with Applications in Generative Modeling and Domain Adaptationcited by 87
  5. 2017Smooth and Sparse Optimal Transportcited by 83
  6. 2016Restricted Strong Convexity Implies Weak Submodularitycited by 52
  7. 2019Multi-Hop Paragraph Retrieval for Open-Domain Question Answeringcited by 34
  8. 2022Sparsity-Constrained Optimal Transportcited by 32
  9. 2017Structured Optimal Transportcited by 31
  10. 2021Generalized Kernel Thinningcited by 29
  11. 2020Rationalizing Text Matching: Learning Sparse Alignments via Optimal Transportcited by 20
  12. 2017Quadratically-Regularized Optimal Transport on Graphscited by 19
  13. 2021On Transportation of Mini-batches: A Hierarchical Approachcited by 16
  14. 2021QA-Align: Representing Cross-Text Content Overlap by Aligning Question-Answer Propositionscited by 16
  15. 2016Tsallis Regularized Optimal Transport and Ecological Inferencecited by 15
  16. 2020Geometry-aware Domain Adaptation for Unsupervised Alignment of Word Embeddingscited by 14
  17. 2017Weakly Submodular Maximization Beyond Cardinality Constraints: Does Randomization Help Greedy?cited by 13
  18. 2021SPOT: A framework for selection of prototypes using optimal transportcited by 13
  19. 2020MMD-Regularized Unbalanced Optimal Transportcited by 8
  20. 2020Statistical Optimal Transport posed as Learning Kernel Embeddingcited by 7
  21. 2022Riemannian block SPD coupling manifold and its application to optimal transportcited by 7
  22. 2020Efficient Robust Optimal Transport with Application to Multi-Label Classificationcited by 6
  23. 2023Consistent Optimal Transport with Empirical Conditional Measurescited by 6
  24. 2023Unbalanced Optimal Transport for Unbalanced Word Alignmentcited by 6
  25. 2019Kernel Mean Matching for Content Addressability of GANscited by 5

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 1; 2025: 0; 2026: 4.

5 papers.