mlsanityData to 14 Oct 2026

Generalized Euler Logarithm and its Applications in Machine Learning: Natural Gradient, Backpropagation, Generalized EG, Mirror Descent and OLPS

arXiv 2502.17500 ↗First posted 21 Feb 2025cs.LG cs.AIcited by 2

Not on the map. Why?

Abstract (arXiv)

This paper investigates in depth the fundamental properties of the two-parameter generalized Euler logarithm and its inverse, the associated deformed (a,b)-exponential function. We systematically clarify the parameter domains that guarantee monotonicity, concavity, and invertibility, derive series and integral representations, and provide explicit links to a broad class of one- and two-parameter deformations, including Tsallis, Kaniadakis, Schw"ammle--Tsallis, Kaniadakis--Scarfone, and Tempesta-type logarithms and their inverse exponentials. In this way, the Euler (a,b)-logarithm is established as a unifying kernel for a wide family of generalized entropies and divergence measures. On the algorithmic side, we extend applications of the Euler logarithm to modern machine learning and optimization. We introduce generalized Exponentiated Gradient (GEG) and Mirror Descent (MD) schemes in which the Euler (a,b)-logarithm acts as a flexible link function in the underlying Bregman divergence. In addition, we propose an Euler-based Generalized Cross-Entropy (GCE) loss for deep neural networks, derive its exact backpropagation formulas, and detail its seamless integration with Fisher-Rao Natural Gradient (NG) descent. By isolating the Fisher Information Matrix (FIM) and developing a diagonal NG approximation, we demonstrate how the two deformation parameters successfully decouple tail robustness from local gradient shaping.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 6 of its 64 references that are in the map. First posted on arXiv 21 Feb 2025.

Builds on

6 of 64 references.

References · 6

  1. 2018Generalized Cross Entropy Loss for Training Deep Neural Networks with Noisy Labelscited by 997
  2. 2014New insights and perspectives on the natural gradient methodcited by 443
  3. 2019Exponentiated Gradient Meets Gradient Descentcited by 32
  4. 2021Exponentiated Gradient Reweighting for Robust Training Under Label Noise and Beyondcited by 16
  5. 2023Boosting with Tempered Exponential Measurescited by 8
  6. 2024Generalized Exponentiated Gradient Algorithms and Their Application to On-Line Portfolio Selectioncited by 5

Built on by

Cited by year

Citing papers per year: 2025: 2.

2 papers.