mlsanityData to 14 Oct 2026

Neural Mutual Information Estimation with Vector Copulas

arXiv 2510.20968 ↗First posted 23 Oct 2025cs.LGcited by 4

Not on the map. Why?

Abstract (arXiv)

Estimating mutual information (MI) is a fundamental task in data science and machine learning. Existing estimators mainly rely on either highly flexible models (e.g., neural networks), which require large amounts of data, or overly simplified models (e.g., Gaussian copula), which fail to capture complex distributions. Drawing upon recent vector copula theory, we propose a principled interpolation between these two extremes to achieve a better trade-off between complexity and capacity. Experiments on state-of-the-art synthetic benchmarks and real-world data with diverse modalities demonstrate the advantages of the proposed estimator.

Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 44 of its 73 references that are in the map. First posted on arXiv 23 Oct 2025.

Builds on

44 of 73 references.

References · 44

  1. 2024The Llama 3 Herd of Modelscited by 14,715
  2. 2018Representation Learning with Contrastive Predictive Codingcited by 7,777
  3. 2016Densely Connected Convolutional Networkscited by 6,720
  4. 2022Flow Matching for Generative Modelingcited by 5,702
  5. 2019Normalizing Flows for Probabilistic Modeling and Inferencecited by 1,323
  6. 2018Learning deep representations by mutual information estimation and maximizationcited by 1,273
  7. 2016Deep Variational Information Bottleneckcited by 930
  8. 2016InfoGAN: Interpretable Representation Learning by Information Maximizing Generative Adversarial Netscited by 860
  9. 2017Masked Autoregressive Flow for Density Estimationcited by 684
  10. 2018MINE: Mutual Information Neural Estimationcited by 683
  11. 2019Neural Spline Flowscited by 596
  12. 2016Error bounds for approximations with deep ReLU networkscited by 574
32 more
  1. 2019On Variational Bounds of Mutual Informationcited by 559
  2. 2019On Mutual Information Maximization for Representation Learningcited by 316
  3. 2020CLUB: A Contrastive Log-ratio Upper Bound of Mutual Informationcited by 235
  4. 2018Formal Limitations on the Measurement of Mutual Informationcited by 189
  5. 2019Understanding the Limitations of Variational Mutual Information Estimatorscited by 140
  6. 2020Telescoping Density-Ratio Estimationcited by 108
  7. 2020Neural Approximate Sufficient Statistics for Implicit Modelscited by 74
  8. 2020On Mutual Information in Contrastive Learning for Visual Representationscited by 54
  9. 2013Equitability, mutual information, and the maximal information coefficientcited by 45
  10. 2019CCMI : Classifier based Conditional Mutual Information Estimationcited by 37
  11. 2023Beyond Normal: On the Evaluation of Mutual Information Estimatorscited by 37
  12. 2023MINDE: Mutual Information Neural Diffusion Estimationcited by 31
  13. 2023TACTiS-2: Better, Faster, Simpler Attentional Copulas for Multivariate Time Seriescited by 26
  14. 2021Unsupervised Hashing with Contrastive Information Bottleneckcited by 24
  15. 2024Mutual Information Estimation via Normalizing Flowscited by 22
  16. 2024Approximating mutual information of high-dimensional variables using learned representationscited by 21
  17. 2023Information Bottleneck Analysis of Deep Neural Networks via Lossy Compressioncited by 19
  18. 2021Tight Mutual Information Estimation With Contrastive Fenchel-Legendre Optimizationcited by 18
  19. 2023Estimating the Density Ratio between Distributions with High Discrepancy using Multinomial Logistic Regressioncited by 17
  20. 2023Mutual Information Estimation via f-Divergence and Data Derangementscited by 17
  21. 2022Copula Density Neural Estimationcited by 13
  22. 2024Inf2Guard: An Information-Theoretic Framework for Learning Privacy-Preserving Representations against Inference Attackscited by 13
  23. 2022Diffeomorphic Information Neural Estimationcited by 10
  24. 2023Scalable Infomin Learningcited by 8
  25. 2024Your copula is a classifier in disguise: classification-based copula density estimationcited by 8
  26. 2018Information estimation using nonparametric copulascited by 7
  27. 2019Adaptive Gaussian Copula ABCcited by 7
  28. 2021MIND: Inductive Mutual Information Estimation, A Convex Maximum-Entropy Copula Approachcited by 6
  29. 2020DEMI: Discriminative Estimator of Mutual Informationcited by 5
  30. 2017Nonparanormal Information Estimationcited by 4
  31. 2023Towards a universal representation of statistical dependencecited by 4
  32. 2022fastMI: a fast and consistent copula-based estimator of mutual informationcited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 2; 2026: 2.

4 papers.

  1. 2025FMMI: Flow Matching Mutual Information Estimationcited by 4
  2. 2025MIST: Mutual Information Estimation Via Supervised Trainingcited by 1
  3. 2026InfoAtlas: A Foundation Model for Zero-Shot Statistical Dependence Estimatecited by 1
  4. 2026Towards Diverse and Comprehensive Benchmarks for Mutual Information Estimationcited by 0