mlsanityData to 14 Oct 2026

A series of maximum entropy upper bounds of the differential entropy

arXiv 1612.02954 ↗First posted 9 Dec 2016cs.IT cs.CV cs.LGcited by 2

Not on the map. Why?

Abstract (arXiv)

We present a series of closed-form maximum entropy upper bounds for the differential entropy of a continuous univariate random variable and study the properties of that series. We then show how to use those generic bounds for upper bounding the differential entropy of Gaussian mixture models. This requires to calculate the raw moments and raw absolute moments of Gaussian mixtures in closed-form that may also be handy in statistical machine learning and information theory. We report on our experiments and discuss on the tightness of those bounds.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). First posted on arXiv 9 Dec 2016.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2021: 1; 2022: 0; 2023: 0; 2024: 0; 2025: 0; 2026: 1.

2 papers.