mlsanityData to 7 Oct 2026

FMMI: Flow Matching Mutual Information Estimation

arXiv 2511.08552 ↗First posted 11 Nov 2025cs.LG cs.IT math.ITcited by 4

On the map: Diffusion models → Flow matching, time series and science

Abstract (arXiv)

We introduce a novel Mutual Information (MI) estimator that fundamentally reframes the discriminative approach. Instead of training a classifier to discriminate between joint and marginal distributions, we learn a normalizing flow that transforms one into the other. This technique produces a computationally efficient and precise MI estimate that scales well to high dimensions and across a wide range of ground-truth MI values.

Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Placed in Flow matching, time series and science, one of 14 directions in Diffusion models. Builds on 31 of its 62 references that are in the map. First posted on arXiv 11 Nov 2025.

Builds on

31 of 62 references.

References · 31

  1. 2018Representation Learning with Contrastive Predictive Codingcited by 7,662
  2. 2018Learning deep representations by mutual information estimation and maximizationcited by 1,265
  3. 2018Deep Graph Infomaxcited by 1,101
  4. 2019Learning Representations by Maximizing Mutual Information Across Viewscited by 733
  5. 2019On Variational Bounds of Mutual Informationcited by 550
  6. 2017Opening the Black Box of Deep Neural Networks via Informationcited by 494
  7. 2019On Mutual Information Maximization for Representation Learningcited by 315
  8. 2018Formal Limitations on the Measurement of Mutual Informationcited by 189
  9. 2019Understanding the Limitations of Variational Mutual Information Estimatorscited by 140
  10. 2019Information-Theoretic Generalization Bounds for SGLD via Data-Dependent Estimatescited by 118
  11. 2020Telescoping Density-Ratio Estimationcited by 108
  12. 2020Generalized Energy Based Modelscited by 73
19 more
  1. 2019Wasserstein Dependency Measure for Representation Learningcited by 69
  2. 2015A Review of Feature Selection Methods Based on Mutual Informationcited by 67
  3. 2018Chaining Mutual Information and Tightening Generalization Boundscited by 65
  4. 2021Density Ratio Estimation via Infinitesimal Classificationcited by 59
  5. 2023Beyond Normal: On the Evaluation of Mutual Information Estimatorscited by 37
  6. 2019Quantifying High-order Interdependencies via Multivariate Extensions of the Mutual Informationcited by 30
  7. 2024Mutual Information Estimation via Normalizing Flowscited by 22
  8. 2023Information Bottleneck Analysis of Deep Neural Networks via Lossy Compressioncited by 19
  9. 2022Diffeomorphic Information Neural Estimationcited by 10
  10. 2022Conditional Independence Testing via Latent Representation Learningcited by 9
  11. 2025InfoBridge: Mutual Information estimation via Bridge Matchingcited by 7
  12. 2023On the Effectiveness of Hybrid Mutual Information Estimationcited by 6
  13. 2024Efficient Distribution Matching of Representations via Noise-Injected Deep InfoMaxcited by 4
  14. 2025Neural Mutual Information Estimation with Vector Copulascited by 4
  15. 2024SOmegaI: Score-based O-INFORMATION Estimationcited by 3
  16. 2024Leveraging Superfluous Information in Contrastive Representation Learningcited by 3
  17. 2025RFMI: Estimating Mutual Information on Rectified Flow for Text-to-Image Alignmentcited by 1
  18. 2025Curse of Slicing: Why Sliced Mutual Information is a Deceptive Measure of Statistical Dependencecited by 1
  19. 2025Dynamic Functional Connectivity Features for Brain State Classification: Insights from the Human Connectome Projectcited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 1; 2026: 3.

4 papers.

  1. 2025MIST: Mutual Information Estimation Via Supervised Trainingcited by 1
  2. 2026Relative Entropy Estimation in Function Space: Theory and Applications to Trajectory Inferencecited by 1
  3. 2026Zero-Flow Two-Sample Testscited by 1
  4. 2026ALICE: In-context, Zero-shot, Mutual Information Estimationcited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2025MMG: Mutual Information Estimation via the MMSE Gap in Diffusion
  2. 2024Stream-level flow matching with Gaussian processes
  3. 2024DFM: Interpolant-free Dual Flow Matching
  4. 2025On The Hidden Biases of Flow Matching Samplers
  5. 2025Score-Regularized Joint Sampling with Importance Weights for Flow Matching
  6. 2023Functional Flow Matching
  7. 2026Exploring and Exploiting Stability in Latent Flow Matching
  8. 2026Flow Matching under Noisy Latent Structure: Beyond Exact Low-Dimensional Support