A new pathway to generative artificial intelligence by minimizing the maximum entropy
Not on the map. Why?
Abstract (arXiv)
Generative artificial intelligence revolutionized society. Current models are trained by minimizing the distance between the produced data and the training set. Consequently, development is plateauing as they are intrinsically data-hungry and challenging to direct during the generative process. To overcome these limitations, we introduce a paradigm shift through a framework where we do not fit the training set but find the most informative yet least noisy representation of the data simultaneously minimizing the entropy to reduce noise and maximizing it to remain unbiased via adversary training. The result is a general physics-driven model, which is data-efficient and flexible, permitting to control and influence the generative process. Benchmarking shows that our approach outperforms variational autoencoders. We demonstrate the methods effectiveness in generating images, even with limited training data, and its unprecedented capability to customize the generation process a posteriori without any fine-tuning or retraining
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 12 of its 33 references that are in the map. First posted on arXiv 18 Feb 2025.
Builds on
12 of 33 references.
References · 12
- 2017Attention Is All You Needcited by 59,932
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
- 2022Generative Adversarial Networkscited by 5,603
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
- 2023Extracting Training Data from Diffusion Modelscited by 723
- 2023Composer: Creative and Controllable Image Synthesis with Composable Conditionscited by 303
- 2022SmartBrush: Text and Shape Guided Object Inpainting with Diffusion Modelcited by 276
- 2024ControlNet++: Improving Conditional Controls with Efficient Consistency Feedbackcited by 153
- 2023Explicitly Minimizing the Blur Error of Variational Autoencoderscited by 29
- 2023Exact minimax entropy models of large-scale neuronal activitycited by 3
Built on by
Not cited yet.